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FOREIfORD 



For the benefit of those mathematics teachers who 

wish to improve their teaching through independent reading, 

the School Mathematics Study Group plans a series, STUDIES IN 

MATHaiATICS, on various topics directly related to high school 

mathematics courses. Particular attention will be paid to 

topics itfiich play an Important part in the courses being de- 
veloped by the Scl^ol Ifathematics Study Group. 

One such topic is elementary set theory. Indeed, this 
plays an important role in practically all of the recent 
recommendations for the improvement of high school mathema- 
tics courses. We are indeed fortunate to obtain, for the 
first volume of the STUDIES IN !1ATHS!ATICS series, an ex- 
tensive exposition of the basic concepts of elementary 
set theory together with illustrations of the use of set 
concepts in various parts of mathematics. 

This material was prepared by Professor R. D. Luce, of 
Harvard University , for a teaching program of the Operations 
Research and Synthesis Consulting Service of the General 
Electric Company. The School Mathematics Study Group is 
grateful to the General Electric Company for permission to 
make this material available to high school teachers. 

Although some revisions and corrections have been made, 
this is essentially the first draft prepared by Professor 
Luce. It is hoped that a revised and extended version of 
this material will be prepared in the future . 
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SOiCE BASIC MMBEMATinAL CONC^IS 



XSTROIXICnON 

As you fljpBt study this material, it may seem both more fim and much 
leas useHil than some other mathematical topics you have studied or are 
studying. T.f nl 1 ke the other subjects you are studying, most likely you 
will never be able to q,uote a specific result from these materials 
which you have used directly to solve a joNDbleo, but if you absorb the 
ideas you will find yourself foimulating problems and reasoning about 
them in a way that is nev and useftil. 

We shall be concerned with some of the basic building blocks of 
precise, logical thought — a whole collection of ideas and concepts and 
methods which, in tdiemselves, are sia^sle and almost faruiliar, yet which 
can be lyramided and intexvoven to yield subtle theories of considerable 
power and depth, Uiese will be qualitative ideas, and so the restaltiag 
mthematicB is vastly different Trom the quantitative subjects with 
which you are more familiar: arithmetic, algebra, and the calculus. 
Because the notions are qualitative, they are far ii»re related to much 
of our ordinary lang uage and ways of thinking — to classifying, relat- 
ing, and ordering concepts and things -- than they are to numerical 
ideas. A thorou^ understanding of these basic el^oents of nodem math- 
esaatiuJ. thought pexmlts one to reason far n»re clearly about complex 
qualite.tive situations. Just as a good knowledge of the number system 
penaits one to reason (often in the form of a calcxilation) effectively 
about qiiantitative loxjblems . 

Ixx>ked at another way, we shall be concerned with things discrete, 
whereas classical ma'UiematicB deals with continuous phenomena. !I5ie 
mathematics of physics, which received its primary impetus from Newton 
and I«ibnitz and which flowered in the hands of the great eighteenth 
and ninteenth c«ntury mathematicians, allows us to fomulate and to 
solve problems involving such concepts as length, weight, time, etc. 



!Qie coaason property of these concepts ie that they are infinitely divlBilsle. 
9or such probless the traditional Bsathematlcs seems ideally suited, and 
cannot expect anich, if any, nev understaxuilng of then trcm the aath- 
eaatics ve shall study here. But in other areas of applications — 
Inclnding sooe microscopic physics — the principle of Infinite divisibil- 
ity is sijiiply not mild, not even as a plausible first approximation. 
AtcwB exist in a smll finite nxssher of states . Half a horse Is no horse 
at all. General Electric 's output of large industrial turbines is not 
any real master, but a rather soall inte^r. Being on a particular 
cojMiittec In a cospany Boy be a relevant fact Hbr some probl^is, but this 
hardly se^as a nup&rical concept. Vhat is needed is a discrete sathesBBat- 
ics to parallel mid sij^^^ent our better Isnovn continuous mthesatics. 

It is veil to keep in Bind that such of the world of iooedlate 
perception is discrete, and if one point of view most be held less 
strange than the other, it la not evident that the contimnus-quaatitative 
is it. A. good deal of training, such as four years of engineering school, 
is x^ded iMfbre a person vill concentrate his attention only on variables 
having a continuous character. Yet, you nay ask: if the discrete viev of 
the vorld is quite natural and if ve have an appropriate withemtlcs to 
deal vlth It, then is the child not taught this as veil as the 
traditlffisal fields? Many vould say becaiise it is too difficult, too 
advanced, and of too little use and their arguaents seen strong. Vor 
exBBiple, there is its history of developaent. Qie ideas ve tt'hry^^ speak 
of csae into being only tovard the end of the last century — th^ipande 
of years after Euclid froac elementary gecaaetry and hundreds after the 
calculus vas invented. Bo one vill deny that, once Geor^ Boole (l6l^> 
1864) and 6. Cantor (1345-1918) pot forth these nev concepts, they vere 
accepted as ftradaaental to all aatheaatical thought and that BathaBatics 
(including that of contlznious processes) vas revolutionized; bixt aany 
vlU point out hov rec^t this developaent has been. Can a child be 
expected to Icam vhat the aatheaatical ecanunity could not develop until 
^ years ago? Scae think yes. 
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Qie ideas are simple. 'Siey are bo sioople, so iaediatei so amch a 
part of our language and *^<n^nc that is hard to realize that there 
Bi^t be a purpose served in ahstraetiag thea into a syaibolie systen. 
Yet^ as you viU see^ once the abstractions are pointed out, th^ are 
clear and understandable — in &et, you will often have the feeling 
that you knev about this or that all along, but had Just never tztnibled 
to think it out clearly. And you will be right. Were the abstracting 
the end of it, it would be banal; but that it is not, for once the 
foznalization is effected it assumes a lif^ and power of its own iriilch 
is fto richer than will first sees possible. 

!Ehe logical and dearest developcient of a sequence of ideas is 
rarely, if ever, the historical one. Ooa^plex problems are recognized, 
tackled, and often solved before the aore basic and, retrospectively, 
siagpler problems are seen and resolved. 

In these notes we shall try to do three things. RLrst, we hope 
to give you sosae idea of the concepts iribiich are available *^wfi wtiere 
you can find out aore about thea. We will draw heavily on your 
unlbmOated experience in such matters and we shall not attend to be 
as careful about the niceties as wo\ild be necessary in a course in pure 
mathematics. Second, we will delve into one collection of ideas irtiich 
is particularly useftil, attei^ing to show reasonably es^sUcitly how a 
modem mathematician thinks and works with such qualitative problems 
and irtiat kinds of deductive steps as« involved. This work will be 
sooeidiat more formal and jKty seem a bit taxing, btst will try to 
build up to it fairly gradually. As much as ai^thing, your diftlculties 
will arise traa our ordinary habit of reading into statements more or 
less than they imply. Cfae of the qualitiee of matheaatics ~ often, 
thou^ myt always, a virtue — is precision. Professionally, matbem- 
ticians pride themselves on saying exactly what they «*j»<^ meaning 
exactly ybat they say. Itor this reason, statements have to be taken 
literally — a curiously difficult thing to do, especially when one 
has an inadequate intuitive grasp of what is being done . Bxird, we 
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vill -preBtnt several exq^^es ftca the social sciences vhere intezestiog 
results have been obtaii»d by welding together a suaiber of these alwsst 
trite ideas . Eere you vill see soae of the Intellectual pover vliich 
arises ftraoi an adroit intexv^rlng of the al»)st trivial. It is an 
impressive feat once it is understood. 



In all of this ve vill not stress nanipulative skills; there is 
CK>t tine for that. Ve vill feel succes£f\2l if you gain sosae idea of 
}Aia,t the concepts are, i^at they night be good for, and where sore can 
be found about tha. Ibr those wanting to learn sK>re of the details a 
linited number of general references vill be scattered about the notes. 
In addition, the folloving books are basic references to the vhole area: 

Se9B^eny, J. G., Staell, J". L,, and Thompson, G. L., Introduction to 
Finite Matheaatics, Prentice Hall, in press (probable d^te of 
publication: January 19^). 

Kershner, R. B. and Milcox, L. R., Bie Anatomy of IfathenatlcB , 
Ronald Press, Hev York (19^). 

Stabler, E. R., An Introduction to Matheaatlcal IBxoi^t, AMison- 
Vesley, CsBbridge (19^3). 

Vilder, R. L., Introduction to the R)\mdationB of Matheaatlcs , 
Wiley, Bev York (1952). 



TVo bafiic texts of a aore advanced character are : 



Blrkhoff, G., Lattice Oieory, American Hathcmaticai Society, 
Sew York (19^*37: 

Birkhoff, Q. and MacLane, S., A Survey of Mode m Algebra, IfacMillan, 

Sew York (I9it^). 

Vhile ve cannot stress aanipulations, here, as in all rigorous 
disciplines, a real understanding does not usually result fron Just 
reading and listening. l!he real import of the ideas and the floe shad- 
ings of aeaning do not cge^s across until you try to vork vith thea, which 
Beans doing probleas. Tot the aost part ve have chosen very simple ones. 
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jut they won't scea so uatSJ. the Ideas are clearly grasped. Biese 
should be worked even vrhen you feel that you have understood perfectly 
what you have read. If you have understood, the cost in time of doing 
them will be slight; and if you haven't, the gain will be great. 

Ihe starred eectioas and the passages in aaall print are a little 
more difjflcult than the rest of the material. They may be omitted if 
one chooses without causing later difficulties, for the rest of the 
text is self contained without them. However, it is reconaaended that 
they be read, posfaibly on a second time aroimd, for it is in these 
sections that we go beyond the more elementary concepts and attempt 
to show how something can be done with them. 



SETS 

1.1 IHTRODUCnON 

Ooe of the sijnplest and most tabiquitous of laeatal operations is 
recognition — deciding whether an object of perception does or does 
not possess certain characteristics and \rijether along son^ dimension 
one object is the same as or different from another. Set theory uses 
this as its starting point. One could do\xbt that such a til vial base 
can lead to anything such in particular; and^ yet, ftrom it and the rules 
of logic one can deilve the whole of contensporary mathematics . Of 
course, we will not attempt to do so here; we will only try to give 
some of the elements of set theory and a few of the applications which 
arise from it. In practice, these are the useful things to know^ for 
no mathematician traces back his work to the most flmdarontal foimila- 
tion; it is enou^ to know (or imagine) that it can be done. 

Analogous situations exist in physios. It was important to show 
that ft«a the microscopic theory of ^tses, kinetic theory, it is 
possible to derive macroscopic thennodynamics, but it would hardly make 
sense for an engineer designing a heat exchanger to return to molecular 
principles. In the same way, it is completelor uneconomical to do mich 
of every day mathematics by returning to set theory — certainly this is 
true of most engineexlng and physics mathematics • And so zzK>st engineers 
and physicists are not taught set theory. But, at present, when himian 
behavior is lnvt>lved, most nathematical analyses do begin in a very 
basic woy. Possibly in the future an elaborate superstructure will be 
constructed for the behavioral sciences and it will again 1^ impractical 
to retiim to first principles, but this is not yet so. 



ERLC 



-7' 

/ 



1.2 HSMEERSKIF AND NOTATION 



Ihe concept of a set^ or claas^ will be accepted as intuitively 
knovn^ or, as one says in mathematics, it is undefined , !lbough ve «>^ftTi 
not attempt to analyze its meaning into more priisitive terms, it would 
be imkind not to attempt to aid the intiiition by exanyples and suggestive 
discussion. A set separates the universe into two parts: those things 
in the set and those not in the set. Put another way, a set is determined 
by a rule or property: those objects of perception which satisfy the rule 
belong to the set, those which do not, do not belong to it. Consider 
the property of being human and exceeding six feet in height* Diis 
defines a set which we might call the set of "tall people," Given any 
object whatsoever, one must decide, first, whether it is a hxxman being 
and, if so, whether that person is taller than six feet, !Iiiere are two 
acts of recognition required for each object* 

Die rule defining a set can be aliaost anyUiing, however weird, 
provid:^d it meets one iiirportant condition. It must be possible to 
decide for any object whether or not it satisfies the rule. The set 
defined by such a rule is scaaetiiaes (redundantly) described as 'Veil 
defined/' In a great deal of mathematics this stipulation is taken 
pretty much for granted without explicit discussion; but it must never 
be forgotten that it is a very stringent requirement, one not so easily 
met in applications, particularly when people are involved. A person 
is confronted with a mxtltiple choice question, i.e., one having a well 
defined set of alternative answers. Biere is no problem in stating the 
set of answers offered to him, or the answer he gives, but what of the 
set of alternatives he actually considers before meJking his choice? In 
judging his perfoimance this may be crucial. You Isnow this much: it 
must include the answer he actually chooses and it is bounded by the 
available set of alternatives, but it could happen that he does not 
consider all of them. Is it possible to decide \rtiether a given alterna- 
tive is or is not in the set he considers? No really effective way is 
now known to ascertain this, but that does not rn^^nn this will always be 



80. Ve offer this example only as a vaxning that it is easy in practice 
to suppose tacitly that a set is well defined, when ip flact it isn't. 

R>r sets tfith a finite number of elements, the sisxplest, and 
invariably ^maBbiglo^ls, rule is to list all the elements in the set. 
5br exaoiple, the set consisting of t e three integers "one, " "two, " and 
"eight" can he specified by listing them as {1,2,8}. A more bizarre 
set having three elements is {this piece of paper. Queen Elizabeth's 
coronation crovu, the sun). In each case, the order of writing the 
several el«aents is ismterial, thaa 

(1,2,8), (1,8,2), (8,1,2), (8,2,1), (2,8,1), (2,1,8) 

all denote the same set. 

Vfhenevcr one explicitly lists all the elements of a set, it is 
conventional to surround the symbols for the elements by curly 
brackets as we have done. 

More generally, a set is characterized by some property possessed 

by its elements and not possessed by any other objects. Such a rule 

nmst always be used «hen describing a set having an infinite nuniber of 

elements, ^r example, the set consisting of all nunibers greater than 

zero is called the "right half line." {The term arises ftrom the 

geometrical representation of all nimibers by a line.) Hie property 

which specifies the elements in the set is "being a real number and 

being greater than 0." Ihus, 1, n, 1,036. 2U, etc. are in the set; 
6 

0, -1, -10 , etc. are not. "Hie members of the Senate of the Uhited 
States on January 1, 1956" defines a set of 96 people whoa one can list. 
"Ihe Pl^sictent of the Uhited States in 191*2" singles just one person* 
and it affords an example of a set consisting of a single eleiaent. One 
must distinguish between a set having but one element and the element 

♦Bad we changed the date, say to 19^+5, this would not necessarily be the 
case. 



itself. Congress obseirves thie nicety ¥hen^ on occasion. It by-paases 
the rule that it cannot write a lav which iVimps and fires a person* 
Diia it does by abolishing all Jobs satisfying certain characteristics, 
so choosing the characteristics that there is a single position — held 
by the xnn they vish to get — * satisfying them. !ItechnicauLly, Congress 
has vrittim the lav in tens of a set, not an element. Notatlonally, if 
a denote^i an eleiaent, then (a) denotes the set consisting of Jiist that 
element • 

Observe that in our discussion there have really l^en three central 
imdefined concepts: set, element, and belongs to. Biese are related by 
a particular element either belonging to or not belonging to a given set* 
It is useful to }^ able to symbolize this jorLmitive relationship briefly; 
it is done as follows: If a is an element of, i.e., belongs to, the set 
A, we write 

a € A. 

In this context, the symbol € (Greek epsilon) can be read in a variety 

of ways: belongs to, is an element of cr is a member of. 

Thus, 2 1,2,8 , i.e. 2 is a menbor of the set ccnsistdng of 

1, 2, and 8, Son^times we also want to say that ''a is not a icexsber of 

the set " and this we symbolize by 

a B, 

where the slash means "not." So we read ^ as: does not belong to, is 
not m element of, or is not a member of. 

We now have notationfid ways of representing two things. First, we 
can symbolize a finite set by explicitly listing its elements: 
{a,b,c,d) . Second, if we have symbols for a set and an element, ve 
can symbolize that the element is or is not a member of the set: a € A, 
a / B. It would also be uaefUl to have a symbolic way to represent a 
set which is ch€iracterized by soim rule or property^ say property P. 
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It is conventional to denote (and that is all it is - a nasie) tliis 
set "by: 

(x I X has property P} . 

In this notation, x is a generic element of the set being defined by 
the property P, and the vertical bar is read ''such that," Thus, we 
read the symbol as "the set of i elements x such that x i^*^^ property 
P. " For example, the right half line laentioned above would be 
presented as: 

(x j X is a real nixmber, x > 0) . 

conventioTis we have employed had best be made explicit. In 
so flaar as possible, capital Latin letters will be used to denote sets 
and mnall ones to denote their elements, and the generic element of a 
given set will often be symbolized by the same letter as the set, such 
as a € A. We will not always be able to hold to these conventions since 
soTCtimes sets are elements of other sets and a particular letter may 
not be suitable for use as an element, but to the extent that we can we 
will follow them. 

A variety of synonyms exist fbr the word set. de most conanon, and 
with some authors the joreferred term, is class. Also used are aggregate, 
collection, and family. There etre some implicit conventions as to when 
each is used, but we will not go into that here except to bb^ that one 
usually speaks of a class or collection of sets, rather than a set of 
sets. 

ProbleiTtB 

1- In two different ways, present symbolically the set of positive 
integers which divide evenly into 12. 

2- Diaplay the set [x | is an integer, x = x} in another way. 




3*Devl8e a property P which is lueaningful for all integers, similar 
to the one in problem 2, vhich allovs the set (O) to be displayed 
in the fons [x \ x has property F) • Do the sasie thing tor the 
set [!}. 

1.3 SUBSETS 

In a certain and sooevhat fiacetious sense, one can characterize much 
of xBodem mathexoatics a^ the ^neration of nev seta flrom old. !Biere is, 
of course, nsuch more to it than this, but constructing new sets having 
special properties is alvays going on. As we proceed you wi3Ll see how 
this can be done with profit • Our first example of it 3 the fbnnation 
of subsets. f0T exsusple, the set of all Kepwblican Senators is a 
subset of the set of all Senators. 15xe emcutive personnel of General 
Electric is a siibset of its eioployees. The set of transfowiers produced 
last week by General Electric is a stibset of all its products for that 
week, and also a subset of all its products for all tijne past, and also 
a subset of clII transformers produced during the year, etc. 

Ptormally, if A and B are each sets, A is a subset of B If every 
eleiaent of A is also em eleiaent of B. In each exaxople you can see 
that this is the case: a General Electric executive is also a General 
Electric employee, etc. Of course, the converse is not generally true ~ 
there are still employees who are not executives. 

If A is a subset of B, we then also say that B is a s\q>erset of A; 
however, this teim will be used much less often than "siibset . " 

CSertain subsets are especially distinguished. Every set is a siibset 
of itself, for if A Is a set €uid a € A then, repeating ourselves, a € A. 
Often, we want to excl\ide this trivial case when talking of subsets, and 
BO we need a texm to refer to siibsets of a set which are different from 
the set itself. Die term used is proper subset . 

Suppose a € A, then (a) is a subset of A. That is, each of the single 




element sets foraed from the elexaents of A is a subset of A, 



One of the niost useful sets, though at first it seems senseless, if 
not silly, 5s the one (it can ^ shown to be unique) which has no 
elexaenta; it is c a l led the eippty or null set. Bie mjor reason for 
introducing this apparently vacnoizs concept is this: you ney set up a 
certain property and discuss the set of eleiaents having this property, 
only later to discover that there were no elements satisfying it. It is 
more convenient not to have to deal witJi this vacuous case any different- 
ly from nore substantial sets . Bae set of all United States Senators 
under 25 years of age is an exaa^fcle. But, you will say, no one would 
ever consider this set, for it is clearly empty. Although that is true for 
this example, there are other cases where the emptiness of the defining 
characteristic is not nearly so evident. If you don't know much about 
cats, to speak of tri-colored male cats does not seem unreasonable. Later 
we shall come to other reasons for introducing the niill set. 

Nbtationally, we shall denote the null set by 0. 

We observe that the empty set is a subset of every set, for every 
element of 0 ie, by its non-existence, also an element of every other 
set. 

Once ag ain, it will be convenient to have a short symbolism for 
discussing subsets. 5br the lAirase "A is a subset of we will write 
A C B. This symbolism is not ^x;st accidently similar to the ''less than'' 
sign, < , for nimibers, for if A is a subset of B it is, in a sense, 
"less than" B. However, one never says that, rather that A is a subset 
of B or that A is included in B. Hxe mark C is known as the inclusion 
sygfcol . 

Actiaally, what we have been doing Just now is mking a definition, 
sn let us suraaarize it formally: 
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Definition ; If A and B are sets, ve say A is a subset of B, and 
write A C if a e A istplies a £ B. 



In teims of the inclusion synObol, ve alvays have: 
A C A; 0 C A; and if a € A, then {a} C A. 

Hot only will ve want to talk of specifi?: subsets of a set, but 
also of the set of all siibsets of a given set. tMs too ve want a 

sysibol. We could siioply say that we will lixite 2 for the set of sub- 
sets of A, "but it will be easier to reiaeiriber ■Uois if we suggest how it 
arose . Suppose that A is a finite set with the n clejaents a^, ag, . . . , 
(the nusKbering of the subscripts does not matter except that we hold it 
fixed and that different elements have difftercnt subscripts). One way 
of denoting a subset of A is as fallows: We ask if the first eleoent, 
a^, is present in the subset or not. If it is %e write down a 1, if not 
a 0. Bien we ask if the second one is in the subset, and we write a 1 to 
the rigjit of our first number if it is, a 0 if it isn't. We continue the 
process through all n elements, and in this way we get a sequence of n 
numbers, M.ch either 0 or 1, iirtJich describes the suCbsot. Jtor example, 
suppose n = U, then the subset i&^f^i^) is symbolissed "by 0101. SimiDarly, 
the single element set {a,} is represented by CX)10. We also note that 
any such sequence of O's and I's represents a subset, i.e., the binary 
nxmibers of length n correspond perfectly with the subsets of any finite 
set of n elements. But it is easy to see that there arc 2*^ such numbers, 
for there aire two choicee, 0 or 1, tor each place and thearare n places, 
Bie symbol, then, fbr the set of subsets of A, 2^, is suggested by the 
Buasber 2°. Biis synibol is used even if A has an infinity of elements, 
where the binary representation of the subsets Mght bi'eak down. 

Jtonaally, 

2^ = (B I B C A} . 
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As an example, suppose A = (a,v),c}, then 

2^ = {A, {a,b},{a,c),{b,c),(a},{b},{c], 0). 

The distinction between the symbols € and C nust be kept in mind, 
for they are sometimes interchanged by novices. One can never be 
directly sxibstituted fbr the other, for e establishes a relation be- 
tween an elejaent and a set, whereas C relates a set to a set. A few 
examples wiU make this clear: If B C A, then B e 2^. If a £ A, then 
Ca} C A and {a} € 2^. 

In set theory. Just as in ordinary algebra, it is quite possible 
to speciiy the saise thing in several difTerent ways; soroetimes this is 
done on purpose, scaaetimes inadvertently. In algebra, ve may introduce 
two apparently different nunibers x and y, but by some chain of reasoning 
c<»De to the concltision that they are the saiae number, in which case we 
write X = y . Similarly, with sets we may think we are defining two 
different sets A and B only later to find that they have the same 
elements — that they are identiceil. In that case it seems aj^ropriate 
to extend the use of the equal sign and to write A = B. When you sec 
such an expression and A and B are sets, you must remember that numbers 
are not involved at all; it simply mams that the tw sets A aid B have 
exactly the same elements, not Just the same nusiber of elements. 
Example: suppose A is defined to be the set consisting of the final 
four words in the last sentence, and B is defined to be (elements, 
number, sane, of] , then A = B. Less trivial example: Let A be defined 
to be the set of two people comprising the Democratic nominees fbr 
President and Vice President in l9kQ and B the President and Vice Presi- 
dent in 19^1, then it is known as an historical fact that A = B, though 
it co\ild have happened otherwise. 

Note that if A » B, then A is included in B and B in A; and, converse- 
ly, if both inclusion relations hold, the two sets must have the same 
elements. This gives us an easy way foiitially to define equality: 
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Deftnittoa ; If A and B are sets, ve say they arc equal, and vrite 
A « B, if both A C B and B C A. 



This concept of equality heis all the properties one usually 
associates with equality aaaong n\sabers, aamely: 



A = A 

if A = B, then B = A 

if A = B and B = then A « C 



(reflexive ) 
(symnetric ) 
(transitive) 



Ihe terms in porantheses are standard for these three xoroperties, and 

they will be discussed niore fully in Ch^ter 2. Oae caa ingaediately establish 
that these properties hold Itom the f aet that inclusion is reflexive aid 
transitive s 

A C C 

if AC B and B C C, then AC C. 



(The reader should show this) . IBiese last two properties caa be shoiai flrom the 
defiaitiai of inclusiai, We have previously discussed aid established the first 
of these, Ccnsidar the seocnd; Surjoss a e A. Since ACB, we kaow ftrom the 
dof initial of inclusicti that a e B, But since B CO, the same daf initial 
implies tOiat a e C, But if a e A iinplies a e G, then AC C by deflnitico. 



In any particular discussion or problem, ve will alvays restrict 
ourselves in advance as to vhat elements we want to talk about. In 
other words, ve vill alvays spe'^ify a universal set U at the start 
vhich is chosen to include everything; ve shall want to mention. It 
any sees Strang to bound oiu^elves by such a convention, but in 
practice it is an extresiely useAil device and it will also help us to 
avoid certain logical difficiilties (see next section). tOie practical 
merit aaxnmts to this: if you don't tell your listener vhat you are 
talking about, be literally won't knov except to the extent he can 
infer it ftvA your statements about "Uie unknown universe of discotirse. 
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When we are dealing with basic ideas, this indirect method will be used — 
it is known as the axioaatic method. But when we are discussing Imown 
eleaients and sets, it is iiaporteat to specify wliich ones. Amateurs often 
ftai to be explicit on this score, and it can be very tricky indeed to 
decipher their later marks and syiabols. 

Problems 

1- Let A denote the employees of a company, W the set of female 
estployees, E the set of executives, p the president, J a particular 
aale Janitor. State all relationships you can think of using 

€ and C« 

2- Write out all the subsets of (janitor, president, set of women 
employees} . 

3- If A is a set having 3 elements, how many elements are there 

A # j> 
In the set of subsets of 2 (which we shall denote by 2 )? 

If A has n elements, how many are there in 2 ? How would you 

oA 

denote the elements in 2 which are fbrmed from single element 
sets of 2^? 

U-Let A and B be finite sets. Show 2^ C 2^ if and only if A C B. 
l.U A PARADOX 

Bie logical difficulties in set theory are ftuuous, mainly because 
they were so profoundly shocking to the B»th«natical coiaaunity. Some 
years after set theoiy was first introduced and when it was already 
being widely used throughout mathematics, it was discovered that, by 
using simple reasoning of a type generally employed in natheaatical 
arguments, deep inconsistencies could be exhibited. Since these 
arguments do not differ from those used in everyday mathemtics, >rijich 
has had such rich and usefUl conclusions, much tmease was generated. 
And ^^le a good deal of work has since occurred in the foundations 
of mathemtics, it cannot yet be said tiiat &11 is well. While we can- 
not go into this work, it is easy to exhibit one of the paradoxes. 
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The one ve shall deecribe is knavn as the Russell paradox^ naoed 
after its fhzaed author Bertrar^ Russell. As ve have seen (e.g., the set 
of all subsets of a ^ven set) the elexoents of sets asy themselves he 
sets, a&us, a priori, there is the possibilit/ that l^ere is at least 
one set which is an elexsent of Itself! While ve have not exhibited such 
a set, it is conceivable that one exists. In any case, let us call any 
set xiot having this property. I.e., any set not having itself as an 
e lenient, an ordinary set. !Biese ve knov do exist. Let W denote the 
set of all ordinary sets. Question: is W itself ordinary? 

One way to show that W is ordinary is to assume the contrary is true 
and to show that this leads to a contradiction, i.e., to show the assinsp- 
tion that W is not ordinary leads to an absurdity. Tols ve do. If W is 
not ordinary, then by definition W is an element of itself. But, by 
choice, all of the eleiDents of W are ordinary sets, and so we have a 
contradiction. Thus, we must conclude that the supposition is f^se and 
that W is ordinary. 

This seezas fine. But suppose we had begun on the other tack of 
trying to show that W is not ordinary by assuming it is ordinary and 
arriving at a contradiction. If W is ordinary, then W is not an 
element of itself according to the definition of an ordinary set. But 
all ordinary sets are by choice included in and agadn we have a 
contradiction. 'Jlius, we must conclude that W is not ordinary. 

Ihe dileima is clear: by well accepted deductive procedures we have 
proved both that W is ordinaiy and not ordinary • The resolution is to 
try, in one pLausible way or another, to exclude W and other objects 
like it flxmi being classed as the same sort of sets as the ones which 
are its elements. Ihis we cannot go into. 

TVo closely related paradoxes which are easily remembered are these: 
Consider the assertion " This sentence is fiilse,'' If you assume it is 
true, then you can conclude it is ftuLse; if you assume it f^se, you can 
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conclude it true. Cbxifilder the b&i^p in a town who shaves everyone vho 
does not shave himself. Who shaves the barber? 

R>r Bore discussion of the problwBs lying at the foundations of 
natheaatics, see Wilder 's book mentioned in the Introduction. 

1.5 UNION, KiSSRSECTION, AND CCMPI£ME3iT 

To the child and the saathesBtician there are certain natural 
operations which can be carried out with sets. For the rest of us "Uiese 
conceptual operations seem elishtly illegal, fdr they are carefully out- 
lawed during early schooling when the child is first introduced to another 
basic notion, that of rnaaber. It is obvious to the child that he can 
"add" a set of books that he has to a set of pencils he uses, for that 
is exactly what he does when he places then tc^ther in a bag to carry 
th^ home. Soooetisies he wants to treat the two sets as separate, other 
times as a unit. It depends upon his purpose. Tbis certainly is not 
the addition to which the teacher is addressing herself when she tells 
hia that he can only "likes to likes" and that when he adds likes 
they Bust not overlap. Bie difficulty she is trying to avoid can be 
seen clearly by considering one set consisting of m books end n pencils 
and another consisting of the sane n pencils and p patls of paper. Ibe 
"logical sub" consists of the set of Ixxsks, pencils, and pads, and it 
has IB 4- n + p elements in it, whereas the siaiple arithmetic sum of the 
ntaa£>ex^ of eleoents of the tvo sets gives the nuaber 
(b n) + (n + p) = m + 2n + p. 

Equally well, there is for sets something somewhat analogotxs to 
multiplication, namely, the set of elesents which are coomon to two 
given sets. In the above example, n pencils axe in comoon. ISiere 
are people vho are wealthy and others 1^0 are smart, »*^«^ those who are 
in cosBon to the two sets are both wealthy and smart. 

Suppose, then, that U is our universal set ly^A A and B are two of 
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ito Bubseto^ We vant to be able to syisbolize tlie eet of elements viiich 
are either in A or in B or in both — the sjialogue of addition, ^ere 
are several synibols in \^e, the xoost comiDn being A U B and A 4- B. Ve 
shall use the forxaer to avoid conf\;i8ion vith nuzaerical addition. So ve 
Baake the fbUoving 

Definition : I^t U be given and A, B C then 

AuB={x I xcAorxcB). 

We speak of A U B as the union of A and B, or as A union B. Hie 
term logical sum is also videly used, but ve will avoid it. 

Similarly, ve vant to denote the set of el^oents ccmbodu to A and B, 
so ve make the folloving 

Definition ; Let U be given and A, B C then 

AnB=(x |x€A and x € B} . 

We speak of A n B as the intersection of A and B, or as A intersect 
B* The term logical product is also used. 

If one writes A + B instead of A U B, then it is customary to write 
AB instead of A n B. 

If in the above example ve let A = {books, pencils} and 
B = (pencils, pads), then 

A U B = (books, pencils, pads) 
A n B (pencils) . 

There is a very usex'al graphical device, knoim as a Venn diagram, 
for thinking about these and more ccnoplex relations aioong subsets. 
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Whatever ovar sets nay be, finite or infinite, ve represent theo in a 
looae anaXogsr by regionB in the plane. ISius, we firet select an 
arbitrary region such as in Pig. 1 to represent the universal set U. 
^Qben ve introduce subregions to represent our subsets, sametimes shading 




f^g- 1 Fig. 2 ng. 3 



them for greater clarity. Biub, in Fig. 2 the whole shaded area 
represents A U B, while in Fig. 3 the shaded area is A n B. 



Such diagrams can suggest a variety of questions . For example, 
consider the subsets indicated in Fig. k. What 
about A n B7 It is clear that there is no com- ^ 
mon region to shade, that they have no elements 
in crmmon. In oiir previous teminology, A P B 
is the espty set. &re seems to be a ease where 
the CBpty set eotaes in handy, for it is nice always 
to think of A n B as being a set, Just as A U B is TLg. k 

alwsys a set. As yo\i mi^t eacpect, we often have 

to distinguish whether or not A n B = ^ xnuch as in ordinary algebra 
we have to specify Aether a number if different from zero or not. For 
this reason a special term is introduced, namely: A and B are called 
disjoint if A n B = 0. 




An example may be illustrative. Suppose we taite as our universal 
set a list of corporate functions which mxBt be considered some execu- 
tive 's responsibility. Let each executive in a particular company list 
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those functions for vhich he considers himself responsible, Ihus, each 
executive specifies a subset of the given tiniversal set. It might be 
considered desirable for each pair oT these subsefs to "be disjoint, 
since otherwise there would be overlapping responsibilities. Of course, 
the example also sug^sts that there should be at least one executive 
responsible for each function, *Kiat is, if we extend our idea of union 
beyond Just two subsets (see below), the union of all t^ese subsets shotdd 
be the universal set. A set of subsets having these twc properties - 
every pair of sixbsets is disjoint and every elercnt of the universal 
set is in one of the subsets - is known as a partition of the univezxal 
set. Hhis is a useful concept and it will arise later in another context. 

Another idea suggested by the Venn diagram is shown in Fig, 5^ Here 
we have shaded everything in U which is not in the 
given subset A. This set, known as the cogrplement 
of A (with respect to U) will be symbolized by A* 
fbrmlly, 

Definition : Let U be given and A C U, th.n Pig. 5 

A = {x I x€ U and x A} • 

In this concept the role of the universal set is vital, frequently we 
will simply speak of the ccJmplement of a set, but it will always be 
with implicit reference to a particular universal set. As you can see, 
it is much more important to know the universal set when coinplements 
are mentioned than for unions and intersections, since in any universal 
set vhich includes both A emid B, A U B and ARB always refer to unique 
sets but this is not true for camplements . 

The concept of complement can be generalized very easily to what 
is known as the difference between two sets. The difference between 
A and B, denoted by A-B, is simjxLy the set of elements in A which are 
not in B, i.e., the set of eleiMnts common to A and the complement of 
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of B. See Pig. 6, So we are led to _ 

A 

Defioition : Let U be given luid A, B C then 

A-B » A n B. 

ng. 6 

1-In ft Vena diagraa vith subsets A and B identify the foUoviog 
subsets : 

AUB; AnB;AnB. 
^-Ilxpress the folloviog subsets of U in simpler terms 

f ; U ; A-A ; A-(jj ; A n f ; ; A U U ; A-A ; A n U . 

1.6 OmAnONS 

Beginning vith a universal set U and considering subsets ve have 
aov Introduced a mm&er of "operations," naaely: 

inclusion A C B 

union A U B 

intellection A n B 

coaplezaentAt5 on A 

difference A - B. 

It is plausible that there anist be sone interrelations among these, Just 
as in arithaetic there are relations aaong auidition, multiplication, 
less than, etc. Hie kinds of numerical properties ve have in mind are 
these: 

X (y+ i) « xy + xz} xy « yx; if x > C emd y < z, then xy < xz. 
Tbe question nov is irtiat relations hold aaong the operations for subsets. 
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Hxe easiest vay to surest sosae of theB, and later to gain an 
understanding of the ones ve shall state, is to see vhat happens on a 
Venn diagram. A couple of exaaqples vill do. Suppose, first, that 
AQ B. TSien, vhat about A and B7 On a Venn diagroo, A C B simply 



U 




Fig. 7 Fig. 8 

flaeans that the area representing A is included in the area representing 
B, as shown in Pig. 7* Nov, shade in the areas representing the coanple- 
Bents of A and B, as in Pig. 8, and we see that B is included in A. Oiius, 
the theoreM ve conjecture (it is by no Buans proved just because one 
special case holds) is: if A C B then B C A. W^e will prove it in a bit. 

As a second exasple, let's ask vhat happens vhen you take the 
coxnplenaeat of the union of two sets . In ^g . 9 the two sets A and B 
are indicated and the region A U B is shaded. Fresunably, we want to 
express this as sooe operations involving A, B, A, and B, if possible. 
l£t us draw A and B again, and shade in the areas representing A and B, 




Fig. 9 Pig. 10 



as in Pig. 10. ihe area which has any shading at all represents 

A U B, aad that clearly is different trcm A u B. Die area in which the 

shading is cross hatched represents A 0 B, and we see that is the same 

as the shaded area in Pig. 9. Thus, in this case, ve conjecture: 

A U B » A n B. 
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Ve must strtsss that these diagrams only serve to suggest results; 
they do not constitute |a>oofs. !Qie danger in generalizing f!rom a fev 
special diagraas is either that ve have managed to drav cases vhich 
possess certain peculiarities or that ve ha^ avoided one or tvo 
peculiar cases; in either event the conjecture viU not hold In general. 
'So get a true proof it is necessary to go back to the definitions of the 
operations in terms of elements in the sets and to verify that the tvo 
siies of an equality do in t&et represent the same set. We shall prove 
these tvo conjecttires as illustrations of the method of proof. 

Theorem If A C B, then B C A. 

Proof. definition, IC A if and only if a e B implies a € A. To 
show this, ve assume the contrary - namely, a e B and a ^ A - and 
arrive at a contradiction. "By definition of the coiaplement, a ^ A 
implies a e A. Since by hypothesis, A C B, ve may conclude fross the 
definition of inclusion that a e B. But, by definition of the coople- 
ment, this contiudicts our assumption that a € B; thus, ve must conclude 
that our tentative hypothesis a ^ A is false . Hence B C A. 

In the mathematical literature, such a proof vould either not be 
given — the dangerous word "obvious" being vritten in its stead — or 
would be given In much abbreviated form, e.g.: If a € B and a e A, then 
since A C B, a € B, a contradiction; hence B C A. 

Bieorem A U B n1. 

I^%x}f . By the definition of equality, the assertion is equivalent to 
the tvo inclusions, 

rm CAHB and AOlC A U B. 

We prove each of these separately by supposing that ve have an eleo^nt in 
the set to the left of the incltision relation and then shov it must also 



be in the set to the right. If a € A U then by definition of 
cosplmentation^ a / A U B« TSimb, by definition of the tmion^ a ^ A 
and a ^ or putting this in texms of coapleaenta^ a e A and a c B. 
IBy definition of Intersection; a € A fl B^ so by definition of incltision, 
the first inclusion relation is ahovn. % shoir the second^ ne suppose 
a € A n B. Kllwinating sosie of the steps^ a ^ A and a ^ B, so 
a )^ A U Bj i.e.; a € A U B* !Ibe theory is proved. 

It turns out that there are a vast nuaOber of such relatlonsMpe 
among the several operations defined^ each one of vhi^ ' can be proved 
in a manner similar to that Just used* We do not proj^>ise to prove any 
more of these here; hovever^ a fev of the proofs will be given as 
exercises. Rather, ve shall present without proof a saall, selected 
set of true theorems* It is recosmoended that you drma^ the corresponding 
Venn diagram in each case, for only by examining each result individual- 
ly vill you become familiar vlth its content* ^is is necessary, for ve 
viU use them f^:^ time to time. 

The arrangement of the theor^ns into horizontal groupings is both 
to make them easier to read and to indicate certcun natural grotipings. 
The partial parallel Ijlsting vill be discussed later. !Qie terms in 
parathenses to the right are standard in this area. 



Let A, B, and C be any subset of a given universal set U, 



1- 


A C A 






(reflexive ) 


2- 


if A C B and B C C, 


then A C 


C 


(transitive ) 


3- 


0C A 


3'- 


AC U 


(universal bounds) 


U- 


A U A = A 




A n A = A 


(idea^wtent ) 


5- 


A U B = B U A 


5'- 


A n B = B n A 


(cviiaautative) 


6- 


A U (B U C) = 


6'- 


A n (B n c) = 


(associative) 




(A U B) U C 




(A n B) n c 




7- 


A n (B U C) = 


7'- 


A u (b n c) = 


(distributive) 




(A n b) u (An c) 




(AU B) n (au 


c) 
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8- 0nA = 0 8'-UuA«U 

9- 0UA = A 9'-UnA=*A 

10- A u A = U 10'- A n A « 0 (eompleoentarity) 

11- A"irB = AnB 11'- A n B = A U B (dualissation) 

12- A « A (involution) 

13- Each of the folloving relations inplies 
the other two: 

A C B, A n B - A, A U B = B. 

Ihere are several points to be made. First, you may vonder vhy ve 
choose to present Just these particular theoreaui m'Uier than aoiae others. 
First of all, there are others, e.g., U » 0, if aC B, then bC A, etc. 
TSxe reason is aimply this: once these theorems have been proved by using 
the basic definitions and arguing in terns of elements, then you need 
never do that again. Any other true relation aioong subsets and these 
operations can be proved directly firca these theorems vi-Uiout recoxirse 
to the basic definitions. Here is hov it is dox^ for the tvo escaisples 
ve aentioned. 

Theorea U - 0. 

Proof. ^ theoren 10', U n U « 0. But by theorco 9% D n U • U. 
Sqoating these yields the result. 

Bieorea If A C B, then B C A. 

Proof. l|y theorem 13, A C B implies A n B « A. !ISaking coasplenents and 
using theorem 11 ' , A = A n B = A U B . Erom theorem 5, A=A Ub=B UA, 
and so t^orem 13 implies B C A. 

•Qius, if you learn these theorems, it is possible fbr you to prove 
any true relationship involving subsets, union, intersection, coioplementa- 
tion, and incl\ision simply by manipulating thaa.. It must, however, be 
o&phasizcd that this is by no meanfi the only set of theorems flx)m which the 
remainder can be derived; there are many such, but this seems to be a very 
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iwefol one. 

Second, ve |lAced a mmber of these theoreas in poir&Xlel. Why? 
If you viU emuine ihem carefully, you vlll see that each pair la in 
a sense dual. Specifically, take any one of thCB and uke the follov- 
iog chants: replace each set hy its coopleoent (keeping in nind that 
it can be proved that 0 and U are cosiplemente of each other), interchange 
union and inttrsectioc syaiKsls, cmd reverse the direction of any inclusion 
relations. IBxis vill yield, in essence, the other theorem on the sssie 
liz». Fbr exaaple, consider theory 3, 0 n A = 0. Making the substitu- 
tions yields U U A U, which is alnost, but not quite, theorem 8 ' . In 
stating theorem 8', and xnany of the others, ve have drc^iped the cosiple- 
swntation sign on the A's and B's which vould have oade the pairs perfect- 
ly dual. Cie reason fbr this is that the sets are arbitrary, and ve can 
alvays insexii A for A and have a true theorem, ^us, to prove 8' in the 
foxs stated, ve should have begun vith A in theorem 8, Aside from that, 
there is a perfect duality. 

dird, let us cosBent on each of the theorems so that you will 
gain a iiiller understanding of their meaning. 

1 and 2 have alr^dy been discussed vhen inclusion vas first 
presented. (Section 1.3). 

3-0 C A C ^ simply states the Hact that the empty set is s subset of 
every set and that every set under disctifision is a subset of the universal 
set. 

k-'BM idempotent lavs, A U A =« A and A fl A = A, are quite different 
from aaythlng you are ftimlliar vith troa. arithmetic. If you "add" a 
set to Itself, yoa do not gain mything; if you ask what is coamcn be- 
tveen a set and itself, you find it is just the set. 

5-The coaautAtlv^ lavs say tjc': -uv, oir^' i- of forming union and 



-28- 



intersections does not matter. Siis is jiost like ordinary arithmetic, 
^both for addition and miltiplic&tion. Ibis rule seems so familiar that 
ve often take it too much for granted. Biere are important mathematical 
systems — important in applications — vhere it does not hold. Itetrix 
Bultiplication is a case in x^oint. Or if you devise an algehra for the 
operations in a machine shop, which is possible, not all operations will 
coBomite: to drill and then thread is hardly the same as to thread and 
then drill. 

6-Bic associative lavs, A U (B C) « (A U B) U C and 
A n (B n C) = (a n B) n C, state that it does not matter how you form 
tinlons of more than two sets or how you fOra intersections of them. It 
does not apply to mixtures of unions and intersections I It is necesseoy 
to have such a law, for both operations were defied on*v' "^t pairs of 
sets. TtilB rule is Just like those in arithmetic, and here as there 
one customarily droj^ the parentheses and simply writes A U B U C, 
A n B n C, etc. ]&it don't drop parentheses i^en there are mixtiires of 
the tmion and intersection syinbols . Ttm symbol A U B ft C is anbiglous . 
Docs it mean A U (B n C) or (A U B) n C? Draw a Venn diagram to see how 
different these are. 

I'Tbe distributitive laws tell you how to expand (or equally, to 
contract) mixtures of unions and intersections. If you think of union 
as analogous to sum in arithmetic and intersection as analagous to 
product, then the analogue of the first theorem is 

X (y + x)- xy + xz, 

which is a property of ma^rs . The analogue of theorem 7 ' , howevar, is 

X (yx) - (x + y) (x + z), 

which, of course, is false. Thus, wMle there are scsae parailels to 
ordinary arithmetic, they are by no means perfect. 
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8 and 9-The8e are ftdrly straightforward: Bie null set has 
nothix^ in comaon vith axiy other set; any eet adjoined to the uni- 
versal set still yields the universal set; the nuH set adjoined to 
ar^ set does not alter it; and any set has exactly itself in comon 
vith the universal set. 

10- dis property of cois^lciDents is obvious firom the way they are 
defined: a set and its complement have nothing in ccioQion and together 
they exhaust ^he universal set, i.e,, they fona a partition of the 
universal set. 

11 - We proved one half of theorem 11; but, as they are both very 
iiBportant, you should explore the other vith Venn diagrams. In vords, 
these theorems say that the cooipleiaent of a union is the intersection 
of the cottple»ents, and the complexaent of an intersection is the union 
of the cosspleaents . 

12- The cooi^eiDent of the complesient of a set leaves the set 
unchanged. In effect, this is a case of double negation leaving things 
unchanged. 

13- lSii8 theoz^es says, inassenoe^ that ve h^e defjnedtoo many 
concepts as primitive, that vc have been redundant. We could, for 
example, have only defined union and equality, and in terms of these 
introduced intersection and inclusion. Other combinations are possible, 
too. We did not do this because each of the concepts is in one vay or 
another so ijaiportant and because the duality is so much clearer if they 
are all involved. It is, nonetheless, veil to keep theorem 13 in mind, 
for it is often convenient to translate an inclusion relation into one 
of the other tvo fdrms . We did this vhen proving A C B implies B C A 
frofii the theorems. 

Most often these theorems are used to simplify expressions which 
arise in jroblMs involving sets, Just as in ordinary algebra you tise 
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the basic rules to simplify an expreseioa of the foxm 

(x + y) 2 + (x - z) (x + y) to x (x + y). OVo examples vill illustrate 

this. Suppose the set (A n B) U B is given. 



_ using theorem 

(A n B) U B « (A U B) U B 11' 
» (A U B) U B 12 
= A U (B U B) 6 
- A U B. k 



Similarly, 



(A U B) n (A U B) =x [ (A U B) n Al U [ (A U B) n B] 7 

= [A n (A U B)] U [B n (A U B)] 5' 

- [A n A) u (A n B)] 7 

U [(B n A) U (BOB)] 

« [(j) U (A n B)] U [(B n A) U (j)] 10' 

« (A n 1) u (B n a) . 9 



Frobloos 



1- In a Venn diagram of sets A, B, and C, identify the following sets 

(A U B) n C; (A U B) n (A n B); (a n c) U (A n c) . 

2- Represent the two expressions (A - B) - C and A - (B - C) in terms 
of A, B, C, and the operations ~, U, and n. Siurpliiy as much as 
possible . 

3- Simplify the following expressions: 

A n (A U B); A U (A n B); (KaPb) OB} (A D B) U (A n b). 

U-Using the basic definitiocs of union, intersection, cooplement, 
and inclusion, prove theorems 7 and 11 ' . 

5-Prove each of the following relations in two ways (by using 
the basic definitions without recourse to theorems 1-13. and by 
vising theorems I-I3 without ever considering an element}: 

AOBCA and (A-B)Ub=:AUb. 
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!•? SET FUNCTIONS 



This section is re&Uy an aside here; logically it should not cosoe 
' until near the end of the next chapter. But because the Idea of a set 
function enters near the beginning of the probability course^ it seexaa 
advisable to bring it in early here. In essence^ all ve vant to say nov 
is that in various vays sets om hove nuisbers attached to them^ «id often 
such numbers are of interest. R>r example, ^'attached" to sjay finite set 
A is the number of its elements, which is usually denoted by | A { . For 
example, { (1,^,11,6^] { In addition, depending upon vhat A is and 

vhat otir purposes are, there may be other nux&bers. If A is a class of 
students, their avera^ grade is a number associated vith A. Note that 
it is actually associated with A cls a vhole, since it is an average grade, 
and not to any of its elements - the students. If A is a set of banks, 
there is a highest interest x^de ajsiong the banks in A, and this is a 
number attached to A. Indeed, all sorts of aggregated measures which 
do not apply to individuals (people, baxiks, indtistries, countries, or 
vhat have you) but do apply to sets of individuals are examples of what 
ve mean. 

Let us return for the mcsaent to the nmbcr | A |, the number of 
elements in a finite set. Suppose U is a finite universal set, then 
for each stxbset A, the number | A { is defined. In a way, this yields 
soBtfthing like a function in the calculiis or in algebra, something like 

or log X or sin x. With these x&ore familiar functions one has an 
independent variable x, which ranges over the real numbers, and to each 
value of X another nuzober is assigned. In analogy, ve take a generic 

subset A of U as the independent variable, which ranges over all the 

U 

subsets of U, i.e., over 2 , and to each value of the independent 
variable - to each subset - a number is assig^d, | A | . !Qii8 imy 
seem to be stretching the usual terminology for functions pretty ftur, 
especially since we don't seem to have any foxioilas to work with as 
in algebra or trigonometry. We'll come back to this question of 
fbnazlas later, for things are not quite as they seem. ¥br nov, it 



vill sxiftlee to lay that a nisiber of tuefUl ttilogs can be done vith such 
an extended idea of a function. 

In Bvcmmry, then, if D tm any set, a real-valued act ilmction is any 
aasignaent of nv^>er8 to the subsets of U. 

I^bably the aost videly used set fonctions are tuoye arising in the 
theory of probability .Although ve shall not delve into this here,a sis^e 
exaaple vill surest hov they arise. If a die is tbroim only once, 
there are six possible outcoaaes: either a 1, or a 2, or.... or a 6 vill 
caste up. Oius, ve nay take U « (1,2,3,^,5.6) as the set of priiaitive 
events, one of vhieh vill occur. Suppose ve assisse that the die is 
perfectly balanced, so the probability of each of these events occurring 
is 1/6. Nov, ve can also consider sooevhat more complicated events, 
for instance let us say that the event A has occurred if the die cosaes 
up either 1,3,^ or 6, and not if either 2 or ^ appears. We see that A 
is a subset of U, nanely (1,3,^,6) . The event A has a certain pirobabil- 
ity of occurring ^riiich can be coasputed troa the basic |»robablllties; It 
is, of course, k/6. In a siBllar vay ve can assigpi probabilities to 
each of the possible cosrplex events, i.e., to each of the subsets U. 
Ihis set function, and otlwrs like it, are knovn as xai-obabiHty laeasures . 
Of course, in nore general contexts the events are far more cooplex and 
the assi^oaents of probabilities are not r>o slaple, but this example 
illustrates the general case reasoiuibly veil. 

^y and large, the functions of interest in algebra and trigonometry 
have veiy restrictive properties. For exastple, a centiul property of 
the logari-UiB is that 

log (xy) - log X log y. 

Most of the functions vhich arise frooi theoretical considerations in 
physics are not highly arbitrary assignments of one variable to another, 
but are strongly constraixusd in one vay or auiiother. In fhct, "Uiese 
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eonatraiatfl aiv vital to ancb of the caBputational pover characteristic 
of physics. It is siinilarly true that vhen the conceirt of a ftmction 
is get^ralized to set functions, or to even more general functions, ve 
still vlll be aost interested ifi those iidiich'possess various sorts of 
inner constraints. Roug^ily, the value of the function at one argujaent 
will be closely related to its values at other arguments which are them- 
selves related to the first argiaaent, as, for example, x, y, and zy vere 
related aibove. Oemaider the flmction: the number of elements in a 
siibset. It can be shovn that 

|AUB|=|Ai+|B|-|AnB|. 

When a set function arises, one miuz alvays be on the outlook for such 
relationships, for they can be most important. 

dlB whole toisic will be resumed and discussed more fully in CSiapter 3, 
I'roblqui 

1- Prove |AUB|-|A|+|B|-|AnB|. 

2- Shoir |AUBUC| = |Ai+|Bl+|c|-|AnB|-|Ancl 

-|Bnc| + |AnBnc|. 

3- Give an cxaaple of a noa- trivial industrial set function. 
U-Does I A I « I B I imply A B? Does A = B imply | A | = | B | ? 

1.8 ALCSBRAS OF S&TS 

So fkr ve hare tacitly assused that once a universal set is given, 
ve will he interested in all of its subsets. IBiis, however, is not 
always the case in practice — certain subsets may for one reason or 
another be distinguished as important, others not. Consider U to be the 
employees of a ccspany. Host of the possible subsets would have little 
or no factional meaning in the operation of the coaspacy, and so will not 
receive any attention as wholes. But others will be treated as whole 



uoits for at l^st toae purposeB. Tor exaaiple, the subsets corresponding 
. to departsaents in the coapasiy xaoy be in^rtant . If so, then it usually 
foUovs that the people (if thsre are aoy) oc^ttooi to two aepartmaatti are 
also iiiQxsrtant -- they aay have xDore power or inforimtion than the other 
■esbers of their departaents. Also the subset which consists of the 
union of two departaaents presuiaably is an important unit, i^r example, 
they nay fora an operating coalition against the rest of the company. 
Finally, if one isolates a departaaent as important, then its corporate 
enviromsent — rJJ. the rest of the cosspany -- also bears consideration. 
In other words, if ve single out a class of subsets as iaqportaat, it is 
more than reasonable for us to include their unions, intersections, and 
cosplements as also important. But why stop at this level? What of 
the unioiuB, intersections, and complements of these nev sets, and so on. 
EventuaOly, this larocess will stop in the sense that any "new" union, 
intersection, or cousplement is not really new; it is one of the stibsets 
already included. At first, one may thinls that this procedure would 
necessarily generate all the possible subsets of U, but this is by no 
means necessarily so . Tor cxamsle, if we begin only with the stibsets 
^ and U, we will never get more than these -^^io sets. In the industrial 
example, we will only get subsets of people closely related to depart- 
mental lines, and not many of the crazy subsets which criss-cross 
departaents without any xh^ae or reason. 

Ibe important thing to notice is that in filling out one of these 
classes of subsets, we stop vhen the following properties are met: the 
union of any two sets flxn the class is again in the class, the inter- 
section of any two sets frcm the class is again in the class, and the 
ccaBploaent of any set from the class is also in the class. In other 
words, the class is closed imder the operations of union, intersection, 
and coEplementation closed in the sense -th&t we cannot get outside 
it by means of these three operations. 2his is a very familiar property 
of nany systms we know: the sum of two nuoibers is again a number, i.e., 
nuaibew are closed under addition; the vectorial coaaposition of two 
forces is again a force; etc. 1^ and lar^ in mathesatics we are 
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interested ia operations which are closed, for then ve are fjree to 
perform the operations vhenever ve lllie without concerning ourselves 
whether ve win get outside the set of elements we are interested in. 

So in sumaary, we make the fo3J.owing: 

Definition ; Let he a class of subsets of a given set U. ^ Xb 
an algebra of sets if whenever A c ^ and B e then A U B e /(, 
A n B e and A € ^. 

As suggested above, ((j), U) is an algebra of sets — the ssiallest 
one. ^is is easily verified. 

Suppose ve know that ve want a particular non-empty proper subset A 
of U to be in an algebra of sets, but so far as we are concerned it does 
not natter if any other subset is in /t. !Iben, we adght look for the 
sssallest aOgebra of sets which contains A. We know that if A e then 
A e S3 we have to have at least (A, A, (|), U} . Hie question is: do 
we have to add on anything more? No, as you can easily check by applying 
the definition: CA, A, ^, U) is, indeed, an algebra of sets. 

Of course, the set of all subsets of U is also an algebra of sets 
the largest possible for U — since any set operation on siibsets of U 
yields a siibset of U. 

Given any arbitrary class of subsets of U, it is always possible to 
find the sssallest (it is imique!) algebra of sets containing the given 
class . 

IVoblems 

1-Let U «s {a, b, c, d). Construct the smallest algebra of sets 
containing {a} and (a, b} . Construct the smallest one containing 
(a) and Cb, c) . Compare these two. 



-36- 



ERIC 



2- Let A, B C U» Shcjv that the easalleet algebra of eets contaioing 
A and B i« the same as the eraallest one containing A, A U B, and 
A n B, 

3- Let ^ and $ he two algebras of subsets of U, If JiC f show that 
for each A e / there exiats a B e ^ such that A C B. 

1.9 I£GI5IATIVi: SCHEMES 

Legislative bodies and casiBittees that reach decisions by voting 
according to fixed legislative schemes are an ever present part of 
modem western life. R>r the most part, they tend to be or^nized along 
traditional tested lines, such as sissple mjority rule where each person 
has a single vote . But in some cases, new quirks are siiggested and 
sometimes adopted — an iia|»rtant case in recent history being the 
Security Council of the United Nations, where a crude attempt was made 
to reflect the differential power among the nations. Even the now 
traditional congressional syst«n of the United States included some 
variations which had not been tiled ^en it was first adopted. There is 
often some ambiguity aho\rt what a new set of verbal rules inq)lles far the 
actual operation of a legislature, and the jaroblem is whether we can 
devise a systematic way to see throiigh the verbal fonnulation of a voting 
scheme to its actual implications. In this section, we propose to use 
the tools so far introduced to lay the groxmd work for one such analysis, 
and then in Chapter 3, when we have still more tools, we will present and 
criticize that analysis. 

A legislative scheme, in contrast to a legislature which refers to 
the specific people with all their peciOiarities and affiliations working 
within a scheme, is a system of rules which state the conditions \mder 
which a bill (or motion or what have you) is passed. Ignoring some 
special classes of bills (treaties, for example) and the problem of 
ties, the rule which characterizes the United States legislative scheme 
is this: a bill is passed either if a simple majority in each house of 
Congress and the President votes for it, or if a two-thirds majority in 
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each house of Congress votes for it. Hxe scheme is given abstractly 
vithout any reference to vho is in the legislatiire, what forces are 
acting upon them, vhat party structure there is, etc. To be sure, all 
of these and more are important facts to }mov wh^ trying to undeff-strnd 
the behavior of a particular legislature, but they are quite irrelevant 
in evaluating or understanding the schexae itself. 

As a result, we shall want to deal with legislative roles, not 

legislators • Thus, we suppose U is the set of legislative roles. 

Bien, the legislative scheme singles out certain subsets of U as able 

to pass a bill. We shall call these subsets winn-fpg coalitions — 

coalitions to emphasize the cooperative nature of the ixrocess. All 

other conceivable coalitions are unable to pass a bill and so they are 

called losing > Thus, a legislative scheme, which is usually given in 

the form of verbal rules, is equivalent to listing the winning coalitions, 

U 

i.e., to giving a s\ibset W of 2 . 

A few seconds thought will indicate that not just any old subset of 
2^ will do as c possible legislative sches^. Olxere are certain character- 
istics common to all legislative schemes which serve to put constraints 

U 

on the possible subsets of 2 . First, there is always at least one way 
that a bill can be passed, so W must not be the empty set. Second, it 
would never do to have both a set A and its complement. A, both winning 
coalitions, for then both the bill and its ne^tive could be passed. All 
known scheuies avoid this possibility. Third, the addition of more votes 
to an already winning cc»lition always results in a winning coalition. 
There is no logical necessity for this condition, and not having it 
wouli surely aake legislative bargaining a more exciting and subtle 
activity than at present, but it always seens to be xaet and it has a 
certain compelling ethical quality. 

These we shall take as the conditions chawicterlzing a legislative 
scheme. But, you may latest, there are a nuxsber of other conditions 
which seem Just as basic — at least, they are found in all legislative 
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schexaes. Ibr txasspLe, the empty set is always losing^ a subset of a 
losing coaaition is always losing^ two disjoint coalitions cannot both 
be winning, etc . Iheae, as we shall see, follow logically trom the ones 
we have singled out. Rirthermorej it is our contention that any new 
condition you jorcpose is either a logical consequence of the ones we 
sh a l l. as8un» or we can find an example of a legislative scheme where 
it does not hold. 

Let us sunsmrize all of this conrpactly as a definition. 

Definition : Let U be a given finite set, W C and L = 2^ - W. 
We shall say that W is a legislative scheiae if these conditions eure 
met: 

i. w ^ 0, 

ii . if A e W, then A e L, 
iii . if A 6 W and A C B, then B e W. 

While this is not a very rich mathematical structure, still 3t is 
possible to prove a few trivial theorems of the sort nffintioned ahove. 
tfc shall list five and prove the first three; the last two are presented 
as problems . 

ISaeorca 1- U e W 

Proof. Since by i, W 0, there exists some A € W. But A C U, so by 
iii, U e W. 

Oieorem 2- 0 e L. 

Proof, ly theorem 1, U e W, so by ii, 0 = U e L. 
Bieorem 3- If A e L and B C A, then B e L. 
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Proof. Suppose, an the contraiy, B € then since B C A, iii iapliea 
A € vr. Tbis Is contrary to the hypothesis that A e so B e L. 

gieorem If A, Be V, then A n B ^ 0. 

Although we hcRre dsmSniied what the coapldsraat of a wiming coalitiai 
be losing, ve certainly have not mde the assuasption that the coss^^lexoent 
of a losing coalition xsust be winning. In aany scheines, such as simple 
mjority rule vith an odd xmmber of participants, it ±m tn^e; in others, 
however, it is not. In the Security (touncil it is quite possible to 
have two factions each of which is able to block the passage of a 
motion, for this reason, the coalitions in the set 

B^£A|A€LandA€Lj 

are called blocking coalitions . 

ISieorem 5- B 5^ L. 

TSie BKiin purpose of fonoulating legislative sehe&ies mthematically 
is certainly not to prove such theorems as these — they are much too 
trivial to be of any interest in and of thexcselves. Rather, ve want 
to lay out in abstract form what one cn n xnean by such a scheme bo as 
better to be able to see the implications of a particular schew and to 
compare several competing scheoes. Once it is seen as a mathematical 
system, then one can use mathematical techniq^i^s and reasoning to get at 
the implications involved. As an example, consider the following 
schemes : 

1- a three -man ccsmsittee in vhich each person has ov^ vote and the 
the decisions are reached according to majority rule; 

2- a three -man cooraittee in vhich 1 has two voter, and each of 
the other two men have a single vote. Decisions are made 
according to majority rule, except that when there are ties 
man 2 breaks the deadlock. (Such a scheme might arise if each 



of the men represented & fl&ction, and it was deeiaed that the first 
faction vas stronger than either of the other tvo, a:iid the second 
vas somevhat stron^r than the third 

It la perfectly evident that the first scheme is e^ntaurian, giving 
each mexober of the cc^nnittee equal vei^t. !Qxe second scheme is eqtially 
clearly not egalitarian: the third man is in a far weaker position than 
the other tvo. It is not quite clear intuitively hov much better off 
nan 1 is than nan 2, for although 1 has two votes, 2 can break ties. 
These differences are intuitively dear md the to show it 
conclusively is, of course, to look at the winning coalitions. In 
scheme 1 they obviously are 

W = {(1, 2), {1, 33, C2, 3), (1, 2, 31). 

In scheme 2, we must look more carefully. IQiere is here the possibility 
that the one man coalition {1} be winning. However, against (2, 3) 
that would result in a tie, which 2 breaks, so (2, 3) is winning and (1) 
la not. It is easy to see that {1, 2] and (1, 3) are also winning, and 
so, of course, is (1, 2, 3) . But this is the Bsme set of winning 
coalitions, so in jxjint of f&ct these two apparently different sets of 
rules (ure identical. 

If you look back at the rules, you will iimediately see through them, 
but the point is that you probably didn't at first. As the size of the 
coBsnittee increases and aa the rules are made more ccmplex, it is less 
and less likely that one will be able to see their implications imless 
he carries out some sort of foiiffiuL analysis. Simply listing the winning 
coalitions is one way. This can be tedious however. In Chapter 3 we 
will describe a general ^rmal analysis ^i^ch is applicable to the a 
priori evaluation of power in a legislative scheme and in a wide variety 
of other somewhat related situations. 

The remainder of this section is devoted to laying the backgrotmd 
for these pursuits and as an illustration of the use of set functions. 
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Su^poM ve attach the noOMr I to each of the vlxmlisg coalitioae in a 
leglalative sehegBe aod the amfiser 0 to tto loaios eoalitloas^ then ve 
ha'Te a set fUnetion nhieb is siapdy equivalent to stating the vixmiog 
coalitions. Sbxaally, sneh a function vould be introdnced as fbllovs: 

1, if A e V 

w (A)- 

0, if A e L 

Biis function r vlll he known as the chsaraeteriBtie ftmctlon of the 
legislative scheme W. Since ve lapoeed sobs restrictive eox^tions 
on V, it Bost follov that v also sieets sone restrictive coocUtions . 
Ve could state a vhole variety of them, but they vould not all be 
independent of ^eh other. So ve shall choose a particular set of 
three vhich are fkirly standsrd in literature, osMely: 

i, V (J^) « 0, 
ii . V (U) = 1, 
iii . if A and B are disjoint, 
V (A U B) > V (A) + V (B) . 

Qiese ve prove: Ihe first ifollovs trcm theores 2 above. Sie second is 
an iBoediate consequence of theorem 1. !Itie third is sli^tly nore 
cosq?licated. If A and B are both losing, the right side v (a) + v (B) = 0 
so the inequality or the equality holds. If they are not both losing, 
then by theorca if only one is vinning, and by condition iii on W, 
A U B is %rinning. So in that case, v (A U B) = 1 « v (A) + v (b); 
hence the eq;uality holds. 

Ve claim that no other conditions independent of these follov Trom 
the assumptions about V. To show this, ve vlll prove that any set 
function having values only 0 and 1 and meeting these conditions defines 
a legislative scheme if ve take V - [A | v (A) = 1], 
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i. W ^ 0, fliace v(U) = 1 impUes U e W. 
ii. If A 6 W and A e W, then v(a) « 1 = v(a), and eo 

1 » v(u) = v(A U A) > v(A) 4 v(A) « 1 + 1 « 2, 
"but this is ij^ssible. Baus, ve must conclude that A or A 6 L. 
iii. Suppose A € W and A C B. Eroaa the properties of sets it is easy 
to shov that B = A U (B - A) and that A n (B - A) = 0 , so 

v(B) « v[A U (B - A)] > v(a) + v(B - A) > 1. 
but since v assumes only the values 0 and 1, this means v(b) = 1, 
hence B € V. 

Bius, the idea of a If^^slative scheme and of a set function with values 
0 and 1 and meeting these three conditions are essentially the same. One 
virtue in noting this identity is that we have transformed our qualitative 
problem into one involving numbers, and so we say be able to use some of 
the quantitative matheaatics about which so much is Imown. 

It also turns out that we have arrived at sotBe conditions on this set 
function which are extremely inqportant in a part of game theory. From 
time to time we shall mention parts of game theory as illustrative of an 
application of some of oiir mathenatical ideas, and, in fact, before we 
are done we will have sketched Basse of its central features. !Qie central 
problem studied in game theory is this: several people — called play- 
ers — ore in a situation where each has a number of possible courses of 
action. Depending upon which courses are elected by the several players, 
there will be different consequences for them. Eaui player is supposed 
to have preferences (not in general the same pattern of preferences for 
all the players) among these consequences, and he is assunted to try to 
select his action so as to get what he wants. Bie canplication for him, 
and for the theory builder, is that his oxitcome depends not only upon 
what choice he makes, but upon the choices of each of the others . Ihe 
only Infioxmtion he has about the other players is their jareference 
patterns and that they too are trying to choose their action so as to 
get what they want. The problem is to use this infomation to guide 
action and to predict ^^t will happen. 
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ikt present the theory divides into several parts. Obe iisportant 
distinction is whether there are only tvo or sore than tvo players. 
And when there are more than tvo, another distinction is lAether they 
are Aree to cooperate with one another if they wish or not. In the 
case where cooperation is pexmissable, one proceeds as follows: Suppose 
that a coalition A a subset A of the set of all players — elects to 
form and to cooperate, then it will be faced by socie sort of opposition 
f^^ the other players. The worst possible case it can seet is if the 
rezoaining players. A, also foxia a coalition; this is the worst because 
A can do everything, and possibly siore, thaxi any less unified opposition. 
So a conservative evaluation of A's strength is obtained by #>y:f«nini 
the two "person" g^me ^^ch results irtien A and A are pitted against one 
another. Using the theory of two person gaxaes, which we shall not go 
into here, it is possible to obtain a suitable numerical measure of this 
strength; this znasiber we denote by v(a)« If this nus&ber is computed for 
each possible coalition, then a real valued set function v results. It 
is known as the characteristic function of the gasie. 

It is not by coincidence that we have used the same symbol ^n<^ name 
for this function as for the one introduced in connection with a legisla* 
tive scheiae, for it can be shown mathemtically that the characteristic 
function of any gai&e Kist meet two, and only two conditions: 

i. = 0, 

ii . if A and B are disjoint subsets of U, 
v(A U B) > v(A) + v(B). 

These conditions say, in effect, that the null set has no strength, and 
that the xmion of two disjoint coalitions is never weaker than the sum 
of the strengths of these two coalitions taken separately. Olie union 
can do everything the separate coalitions can, and possibly BK)re. 

It is not unreasonable that a xneasure of the strategic possibilities 
in a legislative srheme should be a special case of such a measxire for 
games in general, since voting on bills is a conflict of Interest 



problem which ought to be encompeiBsed in soiae feshicn by the theory of 
cooperative games. 



We vill not try to pueh these ideas any further nov, for ve are in 
need of more tools. In Chapter 3 we vill continue our program of evalu- 
ating the pover structxire of legislative schemes; hovever, there is no 
reason to restrict it to that special case, so ve shall cast it in the 
ftramevork of general characteristic functions. 



Problems 



Improve theorem h: if B g W, then A n B ^ (j). 

2- Prove theorem 5: B L. 

3- Examine the following legislative schemes by presenting the sets 
V, L, and B: 

a-a four man coaanittee (a^b^c^d) in which they have 2, 1, 1, and 
2 votes, respectively, under majority rule, and where man b can 
can break ties. Note this is case 2 above of a three v^ n 
committee with a two vote fourth man added. What has hapjjened 
to man 3? 

b-{a,b,c,d) in vhlch they have k, 3, 2, 1 votes, respectively, 
under majority rule, and ^ere the chairman can break ties . 
Show that sectoring the chairmnship is equivalent to obtaining 
an additional vote. 

c-{a,b,c,d,e} in which they have 1, 1, 1, 3, and 5 votes, respec- 
tively, under majority rule; imn a has veto power which can be 
overridden by a 2/3 mjority. 



CHAPTER II 



RELATIONS. ORSERiasS, AND FUNCTTOtK 

2.1 PRODUCT SETS 

Having explored aosaething of the generation of nev sets SVoai old 

"by selecting smaller sets — subsets — ftroa a given set, we turn in 

this chapter to questions of building up larger sets ftxun two or xi^re 

smaller ones. An automobile manufacturer may advertise that his cars 

come in ten colors and six zuodels^ giving the customer a choice from 

among 60 combinations. It is obviously much more ccanpact to list the 

set of ten colore and the set of six models separately than to list all 

60 combinations. Similarly, a menu listing ten appetizers, three soups, 

twenty entrees, five vegetables, ten desserts, and four beverages offers 

the diner a choice from among 120,000 cooiplete saeans. Only the paper 

industry could want this set listed in explicit detail. Everywhere you 

look you will find enorzaous sets presented cc^pactly as several much 

smaller sets with the indication that the overall set is generated by 

f 

m aki ng a single choice from each of the simpler sets. Each of these is 
an example of what is known in mathematics as the product of several 
sets. 

The ecusiest case to deal with is only two sets A and B. Qben the 
set of elements of the fom (a,b), ^»^ere a e A f^riA b € B, is known as 
the (Oartesian) product of A and B; it is denoted by the synibol 
A X B. In order to encc^spass the menu and many other examples, we 
must define this concept for more than two sets. For that example we 
have sevS A (standing for appetizers), S (for soui^), E, V, D, 'and B, 
ands the set of all possible meals, AXSXEXVXDXB, 
consists of all possible elements of the form (a,s,e,v,d,b), where 
a € A, s € S, etc . In general when you have more than two sets it is 
kind of messy fitnd, if there are enough of them, taxing to use totally 
diffferent symbols for each. So it is ctxstomary use a single generic 



syobol for all the sets and to differentiate axaong them b/ indices • If 
there are n sets, it is simplest to index them A^, A^, A^. Using 
this notation, then ve can make the following general 

Definition : Let the sets A^, A^, ^ given. The (Cartesian) 

product of these n sets is defined as 

Aj^ X A^ X...X A^ {(aj^,^^. ...^a^) | a^ 6 A^^, a^ € A^, ...,a^ € A^} • 

n 

The symbol on the left is often abbreviated by ^ILA^ • 

i=a i 

It is important to realize that a definite order is involved in the 
several entries of the elements of the product space. Bie first entry- 
is always filled by an element firom A^, and not any of the other 
sets, the second from A^^ and so on^ IQiis is not to say that the same 
element mi^t not be In tvo or more of the sets, or indeed that several 
of the sets may not be identical, but rather that they are distinguished 
as playing different r -^s by their ordering in the product set. !Ehe 
firuit cup in the set of appetizers is distinguished ftxxn the ftuit cup 
in the set of desserts only by being in the one set rather than the 
other. 



In engineering and physical problems one Y 
product space is almost painfully familiar, namely 
the coordinate system drawn in Fig. 11. To see 
that this is a product space, let X denote the set 
of points on the x axis and Y the set of points on 

on the y axis, then the set of points in the whole ^ ^ 

plane specified by these axes is simply X X Y. If 

ve v&nt to work vith a three dimensional Euclidean space^ tben we add the 
third coordinate Z and the whole space is X X Y X 2. Clearly, this can 
be generalized to n dimensions. Since in physics it is often xiseful to 
think of the point (x,y) in the plane as specifying a vector froia the 
origin to that point, it is custooaxy to call the elements of 



X Xg X. . .X X^, vher^ each of the X^ are the sets of real nuabers^ 
(n-dijnexisioaal) vectors , The term n-tugle is also widely used . 

If S = X X. . .X A^, then ve speak of each ae a comjponent 
of the product set S. Coisponents play much the same role as the 
coordinates of u ^tonetrlcal space, thou^, of course, they need not he 
the number system or any other particular set. Since we know that the 
coordinates of a gecaaetrical space are not unique — any rigid rotation 
will do Just as well --we cannot in general expect a product space to 
have a unl(|ue deccmposition into cosxsponents . 

Problems 

■ 

1- Rrescnt a non-trivial industrial exaaple of a product space. 

2- Let A = {male, female}, B = {old, young}, and C ={skilled, unskilled}. 
Write out all of the elements in A X B and in A X B X C. 

3- Using the saxoe sets as in problem 2, express the following set 
(which, in words, consists of all categories of old workers) in the 
most ccsopact way that you can: ((male, old, skilled), (male, old, 
xinskilled), (fenale, old, skilled), (fesale, old, unskilled)). 

If-Suppose S = A X B and T = C X D. What does it mean if aoioeone 
asserts S = T ? 

5-Suppose A = (0,1, 2, 3,li, 5,6,7,8,9) . Where have you seen A X A 
arise? 

2.2 RBIATIONS 

!Ibe ftunl liar term "relationship" connotes a whole class of 
properties which relate one individual to another individual of the 
same general type -- those laroperties X vrtiich appear (at least 
implicitly) in sentences of the form "a has the relationship X to b." 
For emmplef Mr. Smith is a superior of Mr. Jones. Here the relation- 
ship is "is a superior of" and it holds among people. Other c(^2snon 
examples of relationships are "likes" between people "is in a state of 
war with" between countries, "is less than" between nuxabers, "is the 



iBOther of" betvmen people, etc. 

Ihe crucial features about these exaaplee seem to be three: First, 
a relationBhip holdfi between pairs of things of the same general type. 
Second, it generally holds only between soiae pairs, and not between 
others. Ptor exaaple, "mother of" holds only between certain selected 
pairs, namely: each oother and her daughters and sons. "Biird, sometimes 
the order in which the two elements are taken matters : if Jane is the 
mother of Mary, then Mary is not the mother of Jane. In other cases, 
the order may not matter, such as "in a state of war." 

Suppose a set A is given and that R (fenotes a relationship, i.e., a 
property \rfaich may or my not hold between ordered pairs of elements . 
If a,b e A, let us write aRb if the relationship holds from a to b. If 
it does not Lold, we write aRb. Bie list of all pairs (a,b) such that 
aRb is said to be the relation on A induced by the relationship R. 
Actually, we will use the same symbol R to denote both the relation on 
A and the relationship which induces it; there is a slight Mibiguity here 
but it is not really serious. 

But what is a listing of all these jsiirs (B,b)? Simply a subset of 
A X A. It is the subset which is singled out by the given property R. 
Conversely, i.ven any subset of A X A one can always find a relation- 
ship which singles it out. Tiins, we are led to the following 

Definition : An (abstract binary) relati on over a given set A is a 
subset of A X A. If R denotes the relation, i.e., subset of A X A, 
we write aRb if (a,b) c R and aRb if (a,b) ^ R. 

Ihe prefix "binary" to the word relation is needed because we choose 
to deal only with pairs of elements; there are, of course, trinary 
relations (subsets of A X A X A), etc., but these seem to be of con- 
siderably less iraixjrtance , OSie word "abstract" is also prefixed because 
we have not specified the property which singles out the subset R of 



A X A. "For a given set A, it can easily happen that two quite 
distinct relatioaships single out the same subset, in which case ve 
have two different realizations of the sajae abstract relation. For a 
specific set of people, it is entirely possible for the relationships 
"is a fti.end of" and "works with" to be identical, though in general 
they are distinct. 

P roblems 

1- Let A = (United States, Great Britian, Germny, Japan, Russia) . 
Write out the relation " was at war in 19kk with" over A; the 
same thing in 1939. 

2- Ceui you see how to treat a business flow chart and cn organ- 
izational diagram as a relation? Give a simple example with 
which you are familiar, explicitly stating what relationship 
is involved and what the relation is. 

2.3 THBEE JMPORTAOT SPECIAL PROPERTIES 

Here, as almost everywhere in nathematics, one continually has his 
eye out for the recurrence of the same general property in a number of 
important relations. If such a property is detected, it is often useful 
to isolate it and to see how it interlocks with others you already know 
about. Vfe have done a little of this sort of thing before, e.g., when 
we isolated those classes of subsets called algebras of sets. And ve 
will continue to do it. In this section we shall be concerned with 
three general requirements on relations which have loomed very important 
in mathematics . 

First, we shall consider relations in which a.B& holds for every 
a e A. This is true for the relation "less than or equal to" between 
numbers. It ho.Tds by virtue of the fact a = a, so, trivially, a > a. 
It is true for the relationship "lives in the same house as, " since a 
person certainly does live in the same house as he does. It is so 
tautologiC€Ll in these cases, one might begin to wonder if it doesn't 
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alimyB hold, but '"mother of" quickly dispells that conjecture. In that 
relationship, not only does aRa flail for at least one a c A, but a^ for 
every a e A. The saioe is true for "greater than*' between numbers* Still 
other relations have aRa for some a € and aRa for the reminder. An 
example is the relationship "depreciates," for sozae people depreciate 
themselves, others do not. 

Definition : Let R be a relation on the set A. R is said to be 
reflexive if aRa for all a e A; it is said to be irreflexive if 
aRa for all a e A; and it is said to be non-reflexive otherwise * 

In these terms, "less than or equal to" and "lives in the same house 

as" are reflexive; "xoother of" irreflexive; and "depreciates" is in 

general non-reflexive. It vill be recalled that ve spoke earlier of 

inclusion among subsets as being reflexive. Ihls is compatible with 

the present definition since it is easy to see that inclusion among the 

U 

subsets of U is a relation on 2 which is reflexive. 

In a good many applications, it is a question of convention, 
convenience, or taste whether or not to interpret a relation as reflexive- 
For the relationship 'Is in a state of war with'' one must decide whether 
to treat a civil war or a revolution as a war between a country and it-- 
self . For "communicates to" shall we say a person coMEunicates to him- 
self or not? If we say that "a is the brother of b" when a and b have 
the same parents, then 'l^irother of" is reflexive^, but ve would Just as 
easily define it so that it is irreflexive. A certain amount of JudgiKnt 
is soioetin^s needed ^n these ambiguous cases. 

We turn to the next genei«J. category of relations. Earlier we 
em^yiasized that generally the order in which we write the elements 
involved in a relation is material^ that aife is quite a different thing 
from bRa, Think of "greater than" or "mother of." But for some re- 
lationships the order doesn't really mtter; there is a perfect symioetry- 
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"Lives in the sajne hoiise as" is a case in point: if a lives in the 
saiae house as then b lives in the same house as a. Other examples 
are: "equality" between numbers or between sets, "is married to," and 
"is the same size as." Cta the other hand, there are relations like 
'Wither of" where if aRb we know definitely that bm. Still others are 
of a mixed quality. 

Definition : Let R be a relation on the set A, R is said to be 
symmetric if whenever aRb holds, so does bRa; it is said to be 
anti-sgmetric if whenever aRb holds, hBa.; and it is said to be 
non- symmetric otherwise. 

Ihe third important property, which we have already run into with 
inclusion, is typified by any comparative concept such as "larger than": 
if a is larger than b, and b is larger than c, then we know that a is 
larger than c. This is true of set inclxislon, of "greater than or equal 
to," of "lives in the saai^ house as," etc. The other extreme would, of 
course, be a relation where if aiSb and bRc, then we would know with 
certainty that aRc, For example, if a is the mother of b and b the 
xoother of c, then a is the grandmother of c, and so not the mother of 
c. In general, "in a state of war with" satisfies the bbs^ condition, 
but there are exceptions, as when Cosamuiist China, Nationalist China, 
and Japan were mutually at war --at least to all intents --in the 
middle forties. 

Definition ; I^t R be a relation on the set A. R is said to be 
transitive if aRb and bRc always imply aRc; it is said to be 
intransitive if aRb and bRc always imply aSb; and it is said to be 
non-transitive otherwise. 

2.4 KQUIVAI£NCE RELATIONS 

Any relation which is simultaneously reflexive, syinmetric, and 
transitive is called an equivalence relation . 2iis special word is 
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introduced because tiiese relations appear often and play an important 
role in many mtheaatical situations. "Bie equivalence relation "lives 
in the same house as" illustrates vividly the central feature of any 
equivalence relation: it divides the population into disjoint subsets, 
namely, the sets of people who live in the saiae houses. In other 
words, it induces a partitioning of the given population. Let us 
emphasize that this feature is not unique to "lives in the sanie house 
as;" it is true of all equivalence relations. 

We say than an equivalence relation R partitions the set on which 
it is defined into equivalence classes, which are charac-C erized as 
follows: any two elements in the R relation are in the seans class, 
and any two not in the R relation are in different classes. Conversely, 
any partitioning of a set induces the obvious equivalence relation on 
the set. Thus, the idea of a partitioning and of an equivalence relation 
are substantially the same . 

Hie best known example of an equivalence relation ir, of course, 
equality. It is in a sense trivial, however, for the eqxii valence 
classes of the equality relation each consist of a single element, 
whereas, in general, at least some equivalence classes will have more 
than one element. Olie idea of an equivalence relation is therefore, a 
slight, but important, generalization of equality. It says in effect 
that the elements in the same equivalence class are "equal" to each 
other with respect to the property inducing the relation, even though 
they are not identical, as they would have to be for equality. Mare 
often than not, we are concerned with equality along one dimension or 
another, but not strict identity- Often we wish to group things with 
respect to some paran^ter and to treat them as all equal in the rest 
of the analysis. Hiis is what one is doing when one groups people 
according to income levels, or according to religious affiliation, or 
profession, etc. 
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problems 



1- Jbr each of the fbllcving relationships state their reflexivity, 
symaetry, and transitivity properties: 

is the brother of, sells to, gives orders to, is the ancestor 
of, implies, is the son of. 

2- Prove formally that the equivalence classes of an equivalence 
relation foin a partitioning. 

3- Critici2e the following "proof" of this erroneous statement: if a 
relation R on A is synaaetric and transitive, then it is reflexive. 

Proof. Rjr any a € A, the f&ct that the relation is symmetric means aRb 
implies bBa. But by transitivity, aHb and bRa imply aBa, so the relation 
is reflexive. 

*2.5 iiASBIX AND GRAPHICAL HEPKESEMTATIONB OP RELATIONS 

Whenever one has actually to work with real subsets, in contrast 
to making general theoretical statements as we have been doing, there 
is a problem of how best to present them. As a special case of sub- 
sets, the same problem exists for relations; however, Just becaxise of 
their specialness, son^ convenient methods exist for relations which 
are not applicable in general. IHiere are two major methods: a systexiBtic 
tabular one and a less systematic, but often more revealing, graphical 
one. Neither of these methods is terribly practical if the underlying 
set has more than, say, 100 elements. 

■Die tabular scheme is based on the almost trivial observation 
that a relation on a finite number n of elements amounts to nothing 
more than a two dimensional table with n rows and n columns. In the 
entries one mark is placed if the relation holds f!rom the element 
identified with that row to the element identified with that column; 
another if it does not hold. More specifically, if we number the ele- 
ments in A from 1 tnrou^ n, then we put one mark in the entry of row 
i and column J if iRj, and another if iRj. The most widely used scheme 
is to use 1 if iRj, and 0 otherwise. Example: Let A = (1,2,3,4) and 
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B= {{1,2), {2,1), {2,2), {2,3), i2,k), {^i3)}, then the array is 



12 3^ 



1 



0 10 0 



2 



1111 



3 

If 



0 0 0 0 



0 0 10 



This array, ignoring the rov and column laibles, fbnas a 4 by ^ mtrix 
vith only the entries 0 and 1« 

Other possible entries have been suggested and xxsed — the choice 
of convention depends very xmich upon vhat one vants to find out and hov 
one is going to do it* Anong the other 8i;tggestlons, two vill be 
mentioned. Enter a 1 in the (l,j) entry if ifij end a -1 if IRj. let U 
be soaie set (usually having scnie relation to the problem under investi- 
gation). Enter U in the entiy if IHJ, and 0 othervlse. !Qie first 
suggestion results in an ordinary real-valued matrix. Just as when 
0 and 1 are used; the second^ vith its entries sets, is a new kind of 
beast known as a Boolean mtrix* We vjll not look further into either 
of these repi^esentations of a relation. 

Returning to the 0,1 representation^ suppose that the elements of 
A are people in some industrial establishment and that the relationship 
under consideration is ''coBaminicates to*"^ In practice, there are 
serious questions as to vhat cue shall define vcomosmicates to* to mean — 
but jxresim^bly it vould be defined in such a manner that the president 
communl cates to his vice presidents and not to a foreman or a Janitor. 
We need not vorry about such points here . If we choose any two people 
a,b € A, ve may ask: does a ccomunicate directly to b? If not, is it 
possible for him to so via some intenaedlaiy c7 Or by several Intenaed- 
iaries? Obviously, there is no problem to answering the first question^ 
ve BiMply look in row a of the matrix representation and determine vhether 
there is a 1 or a 0 in column b. But to ansver the second question, ve 
must simultaneously look for a I in row a, column c and in row c, column b, 
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and Bince we do not care vho the iateinediary is ve aust do this for each 
possible c. And when we go beyond two-step connections, the problem 
rapidly becoaes very messy. What we must find is a syst«aatic way of 
usin^ matrix operations to answer such questions. 

let us denote by R both the relation and its matrix representation, 

and let \^ denote the entry, either 0 or 1, in row i and column J of 

the matrix R. We note that the product R R ^ is 1 if and only if 

ac CD 

\c ^ ^cb ^ otherwise, it is 0. Thus, there is a two-step 

path from a to b via c if and only if R R . « 1. But since we do not 

ac CD 

care which person c is, there is a two-step path trcm a to b if and only 
if the Sim 

is greater .:-»an 0. Rirthermore, the value of the sum equals the number 
of people in A who can serve as intermediaries from a to b. 

But to anyone knowing aatrix algebra, this sum is very faaailiar; it 
represents the entry of row a, column b in the B»trix obtained by 
aailtiplylng R by itself -- in R . Thus, simply squaring R gives us 
at once the number of two-step paths between ^ch ordered pair of 
elements from A. If R represents direct cooaainication, R^ the two- 
step ones, it is plausible to conjecture that R^ gives the number of 
three-step ones, and in general R^ gives the number of k-step ones . 
Diis conjecture is easily verified. 

The main virtue of this observation is that it reduces a fkirly 
complicated counting problem to a very systemtic procedure -- matrix 
multiplication -- vliich can be carried out by a clerk or by a high 
speed computer if the matrices are very large. 



You n»y wonder what, if any, are the matrix correlates of 
reflexivlty, syoittetry. and transitivity. Pirst^ it is aasy to see that 



a relation is reflexXre if and only if all the entries in the main diagonal 

are I's. Bie relation is transitive if and only if whenever an entry of 
2 

R is non-zero, the corresponding entry of R is also non-zero. This we 

can see as follows: If the (a,o) entry of R^ is positive, then there 

exists at least one b e A such that aKb and bRc. But if B is transitive, 

this isplies aRc, and so R =1. t^** converse is equally easy. The 

ac 

syiaaetry of a relation is not best seen in terms of jaatrix xmiltiplica- 
tion, but in tems of the eyumetiy of the aatrix B. Corresponding to 
syiaBietry in a relation is perfect synsaetry about th^» main diagonal, as 
in the following eymnple 

0 10 1 
110 1 
0 0 0 1 
1110 

It is reasonably evident that these three conditions do not ccmbine 
into a single simple condition for an equivulence relation (which, it 
vill be recalled, is reflexive, syinmetric, and transitive). Nonetheless, 
there is one fact about the natrix of an equivalence relation which is 
worth noting. If one ntcabers the equivalence classes from, say, 1 to s, 
and then nimbers the elements in the first equlmlence class successive- 
ly from 1^ those in the second successively from the last number in the 
first class, and so on, then the l^s in the matrix vill appear as non- 
overlapping squares about the main diagonal. Fbr example, 
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represents the equivalence relation with the equivalence classes 
{1,2,3), ih], (5,6), (7,8), 

Fbr ccjiaputational purposes, the representation of relations by matrices 
is generally effective, but for "mderstsiding" the relaticn 
they leave a good deal to be desired, l^st of us do a lot better with 
some sort of diagranatic representation, of which flow charts, organ- 
icational diagrams, and engineering schematics axe typical. GSie generic 
mathematical term for such drawings is an oriented (topological linear) 
graph . FDrmaUy, an oriented graph is a collection of points and 
directed lines connecting them, as in Pig. 12. 




Fig. 12 

Let it be clear that this use of the word "graph" is somewhat different 
from the one with which you are already familiar: the graph of a 
function on a two dimensional plot. 

In diagrams of oriented graphs it is customary to use a single 
undirected line between ijoints a £ind b if there is both a directed line 
from a to b and from b to a. (OSais we have done in Fig. 12.) 

In the gcMral mathematical concept of a graph there may be any 
numb er of directed and xmdirected lines between a pair of points, but 
we sha l l restrict our attention to the case where there either is no 
line at all connecting them, or a single directed line, or a single 
undirected one. (Oterminology : the points are often called nod*s or 
vertices, and the lines, branches or arcs). 
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It should be clear hov to represent a relation by a graph. Distinct 
points are chosen in the plane, one corresponding to each elexaent of A. 
If aRb, ve drav a directed line from a to b. It does not isatter where 
in the plane ve place tJie points, so long as they are distinct, nor 
does it matter whether we draw straight or curved lines. All the graphs 
in Fig. 13 represent the same abstract relation, and they are all eqiial 
to one another. (The nunbering of the ^ints is introduced to facilitate 




Pig. 13 



your seeing the identity of the graphs • ) Distances and angles are not 
at aH involved in these representations. On the other hand, there 
can be great psychological differences as^ng several different graphs of 
the saioe relation. Consider those shown in Fig. Ik. Jfost people looking 




Pig- 1^ 



at the first drawing will spes^ of it as a simple hierarchy. To som 
people the second suggests "the man behind the throne,'' and to others a 
siasple hierarchy with a bottleneck. Bae third elicits the feeling that 
there is a central person in a focal position of leadership. But, they 
are the saiae graph drawn in slightly different ways. Hiis is not to say 
that vertical organization of the drawing cannot be used to convey soiae 
infonaation, but only that it always seems to even when such was not 
intended . 
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ISae graph of a reflexive relation has a closed loop at each point: 
• Bie graph of a syoaaetric relation has only laidirected lines. OSjc 
graph of a trsuisitive relation has no configurations of the type shown at 
the left of Fig. 15, only those on the right, these remarks it is 




Jig. 15 



easy to guess what an equivalence relation must look like: clusters of 

points with all possible lineswithin each cluster, and none between them. 

An example (with the doeed loops at qbcSo. note omitted) is showi ox the left 
of Fig, 16. The right h«id graph is. 




Fig. 16 



however, the same relation. We show this to enqphasize how difficult it 
can be to detect the properties of a relation drawn in graphical form if 
there are no initial hints as to how to organize the drawing. 'Sic same 
reaark tends also to hold for ira.tx*ix representations. 

One further graph theoreticea idea is needed in the following section. 
Consider the two unoriented graphs (representations of symmetric relations) 
shown in Fig. 17- Exe main difference between these is that the one on 
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the left haa a closed loop of lines: aKfa, bRc, cBd, and dBa; the one on 
the right does i^t. Wh«iever an anoriented graph ftd.lB to have such 
loops, It ic called a tree (the reason being ftdrly obvious). Such 
graphs play an important role wiierever a bifurcating decision process is 
involved . 



Possibly the most extensive application outside of nathenatics 
proper of relatir-^ and their representations is in that part of social 
psychology known as sociometiy. Bae central thesis of this discipline 
is that certain of the relations which exist and be observed in 
groups of people are crucial to an understanding of the behavior of 
groups, and there is an extensive literature exploring empirical data, 
relating it to Bjathematioal la^perties of relations, and probing the 
xaatheaatics of relations itself. A recent stirvey of this naterial is: 
Lindzey, G. and Borgstta, E. F. "Sociraaetric Measurement," Handbook of 
Social Psychology (g. Undzey, ed.), Addison-Wesley, (Abridge (195I+), 



♦Problems 



1-Write the matrix representation of the relation having the follow- 
ing graph: 




^» 



Draw the graph corresponding to this matrix: 

iH 
1 



0 
1 
1 
1 
0 



1 
1 
0 
0 
1 



1 
1 
1 
0 
1 



0 
0 
0 
0 
1 



0 
0 
1 



2-Ftr the last matrix, how many three -step paths are there from 
1 to 5, from 2 to 1+? 
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3-Oan you see any difTicuity in the iaterpretatiou of the entries of 
as the k-step paths in the relation represented by R. 

^-What does tlie matrix coadition R = R mean for the relation 
represented by R? 

♦2.6 GAMES IN EXTENSIVE FORM * 



In section 1,9 we TOntioned one mathematical coaetnict which arises 
in the theory of gan^B (which is the current mathematical model for 
conflict of interest aioong people or organizations) j and here we want 
to discuss another which illustrates the use of scane of the ideas we 
have so far developed. Bie material given here arises at the beginning 
of gaxne theory, when one is first trying to abstract :lnto mathematical 
form what it is that the rules of a parlor game actually tell you. First 
of all, the rules of any parlor gaiK specify a series of well defined 
goves, where each nK>ve is a point of decision for a given player from 
among a eat of siltematives . The particular alternative chosen by a 
player at a given decision point we shall call the choice , whereas the 
totality of choices available to him at the decision point constitutes 
the move . A sequence of choices, one following another until the game 
is terminated, is called a ;play . Let us suppose that in one ^uoe (at 
some stage of a play) player 1 has to choose among playing a king of 
hearts, a two of spades, or a Jack of di^nonds, and that in another 
game a player, also denoted 1, has to choose acKsng passing, calling, or 
betting. In each case the decision is among three alternatives, which 
may be represented by a drawing as in Fig. l8. 

But how can these two examples be considered 
equivalent? Certainly it is clear from common 
experience that one does not desLl with every three- Fig. l8 

choice situation in the same way. One mi^t if they 

were given out of context, fOr there would be no other considerations to 
govern the choice; but in a game there have been all the choices preced- 
ing the particular move, and ail the potential moves following the one 
under considemtion. ISiat is to say^ we cannot truly isolate and abstract 

The wtarial in this secticn Is almost identical to 39-^ of 
Luoe, R.D. aad H, Raiffa, Gameg aad IfeoisicRS. John rfiley, ^ew York, 1957, 

.63- 




each move seputitely, for the significance of each laove in the ganie 
depenids upon some of the other moves . However^ if ve abstract 
all the moves of the game in this ftushion and indicate which choices lead 
to which moves, then we shall know the abstract relation of any given 
move to all other moves which have affected it, or which it may affect • 

Such an abstraction leads to a drawing the type shown in Fig. 19 
to a tree. The number associated with 
each move indicates which player is to 
make the move, and therefore these 
ntmibers ran from 1 through n, if there 
aare n players. In the exaxsple of 
Fig. 19, n = and we see that all 

the moves, save the first, are assigned Rig. 19 

to one of the players; the first move 

has 0 attached to it. A move assigned to '"player" 0 is a chance move, 
as, for example, the shuffling of cards prior to a play of poker. To 
each chance move, which need not be the first 2K>ve of the game, there 
must be associated a probability distribution, or weighting, over the 
several alternative choices, Tf a chance move entails the flipping of 
a fB,ir coin, then there are two choices at the iK>ve and each will occur 
with probability I/2. 

As we naid, the graph of a game is a tree, whi?h is called the game 
tree. It msy not sees reasonable to assume the graph of a game is a 
tree, for in such games as chess the same arrangement of pieces on the 
board can be arrived at by several different routes, \iiiich appears to 
mean that closed loo^ of branches can exist. Hofwever,. in game theory 
we choose to consider two moves as different if they have different 
past histories, even if they have exactly the same possible future 
TOves and outcomes. In games like chess this distinction is not really 
important and to make it apjsears arbitrary, but in many ways the whole 
conceptualization and analysis of games is simplified if it is made. 
^Cie tree character of a game is not unrelated to the sinking feeling 
one often has after making a stupid choice in a gsa^, for, in a sense, 




each choice is irretrievable^ and ort!e it is made there are parts of the 
total game tree which can never agedn be attained. 

T5ie tree is assiODed to be finite in the sense that a finite niimber of 
nodes, and hence branches ^ is involved. Tliis is the saro as saying that 
there ie some finite integer N such that every possible play of the gaioe 
teminates in no more than N steps. Such is certainly true of all parlor 
gajoes, for there is always a ''stop" rule^ as in chess, to tenainate 
stalemates. To say the tree is finite is not to say that it is «tti^ii and 
easy to work with. Tot example, card gajaes often begin with the shuffling 
of a deck of 52 cards, and so the first 0 loove has 521, i.e., approxi- 
mately 8.07 x 10 , branches steraning from it. Clearly, for such gaiMS 
no one is going tc draw the game tree in full detail i 

de next step in the formalization of the rules of a gaise is to 
indicate what each player can know when he sakes a choice at any move. 
We are not now asstnuing what sorts of players are postulated in g^rt ^ 
theory, but only what is the most that tL^y can possibly know without 
violating the rules of the game. Clearly, there is the possibility that 
the rules of the gazne do *^ot provide a player with knowledge on any 
particular m>ve of all the choices made prior to that move. 3Siis is 
certainly the situation in most card gaiaes which begin with a chance 
move, or where certain cards are chosen by another player and placed 
fttce down on the table, or where the cards in one plg^er's h^nd are not 
known to the other players. Indeed, it say be that a player at one move 
does not know, and cannot know, what his dcnnain of choice was at a 
previous move I The most common example of this is bridge where the 
two partners must be considered as a single player who intermittently 
forgets and remembers what alternatives he had available on previous 
moves . 

To suggest a method to characterize the infomation avails ble to a 
player, consider a game whose tree is that shown in Fig. 20. The dotted 
lines enclosing one or more nodes are sou^thing new in our schen^; as we 
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shall s«e they can ^ used to characterize 
the state of iaforaaation vhen a player has 
a iDove. Let us BJxppoBe that the rules of 
this game aseert that on joDve 1 player 2 
must choose a^K^ng three alternatives denoted 
a,h, and c. Reg^urdless of player 2's choice, 
player 1 has the second move. We shall Pig, 20 

oppose that the rules of the gasie penait 
player 1 to know whether or not player 2 selected choice a. If player 2 
chooses then the rules are such that player 1 can only knov that 
either b or c was chosen, but not which. While verbally this may seem 
complicated, grajiiicaJJy all we need do is enclose in a dotted line 
those moves of player 1 which end up on b or c, !Ilie dotted line simply 
means that from the rules of the game the player is imable to decide 
where he is among the enclosed iMves, The single move at the end of 
choice a is also enclosed, for If that choice is made player 1 knows it. 
If choice b was in fact mde, and if player 1 then makes choice f (of 
course, he does no^; know whether he is making f i) the next mare is 
up to player Note that according to the diagram, the rules of the 
game make it impossible for him to determine whether he is choosing 
between n and o or between p and q. 

In general, the rules of any game must specify in advance which 
moves are indistinguishable to the players — the sets we have enclosed 
in dotted lines • Abstractly, there are two obvious necessary features 
to these sets of moves — which are known as information sets . Each of 
the moves in the set must be assigned to the same player, and each of the 
moves must have exactly the same number of alternatives. For if one move 
has r alternatives and another s, where r ^ s, then the player would need 
only count the number of altejmatives he actiaally has in order to elim- 
inate the possibility of being at one move or the other. A third con- 
dition, which may be less obvious, must also be assumed, namely: a single 
information set shall not contain two different moves of the same play of 
the game tree. Bie reason for this is the impossibility of devising rules 





so that a single player is imable to distinguish between two of his ^loves 
which lie on a single play, i.e., on a chain of moves from the first move 
to an end point of the tree. 

Returning to Fis- 20, consider player I's inforroation set which has 
two moves. Since they are indistinguishable, each choice on one move 
must have a corresponding choice on the other move. It is convenient 
in these diagrams to pair them systematically, so f corresponds to i, 
g to j, and h to k. It is clear that this correspondence can be gen- 
eralized to information sets having laore than two looves aad other than 
three alternatives at each move. 

The final ingredient given by the rules of the game is the outcome 
which occurs at the end of each play of the game. Almosx anything may 
be fou»i to be the outcome of some game; for example, the subjective 
reward of victory in a friendly game, or the monetary punishment of 
seeing someone elee sweep in the pot, or death in Russian Roulette. In 
any given system of rules for a game there is scane fixed set of outcomes 
frtsa which specific ones are selected by each of the plays. Each of the 
end points of the game tree is a possible termination point of the game 
and it completely characterized the play of the game which led to that 
point, for there Is only one sequence of choices in a tree leading to a 
given end point from a fixed first move. We may index these end points 
and denote a typical one by the symbol x . Now, if X is the set of 
outcomes, the rules of the game associate to each x an outcome from X 
which we my denote by f (x) . Pbr example, in a game like tic-tac-toe 
the set of outccaaes is {player 1 loses and player 2 wins, player 1 wins 
and player 2 loses, draw). In this case, and in a wide class of games, 
it would be sufficient to state the outcomes for only one of the players, 
but in other situations which are not strictly competitive it is necess- 
ary for the elements of the outcome set to describe what happens to each 
player. 

In susnaary, then, the rules of any game unaiabiguously prescribe the 
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following : 



i. a finite tree vith a distinguished node (the tree describes 
the relation of each move to all other moves and the dis- 
tinguished node is the first inove of the gaiae); 
ii. a partition of the nodes of the tree into n -i^ 1 sets (telling 
which of the n players or chance teikes each move); 
iii. a probability distribution over the branches of each 0 move; 
iv. a refinement of each of the player partitions into the 

the partition of infonmtion sets (which characterizes for 
each player the ambiguity of location on the gas^ tree of 
each of his moves) ; 
V. an identification of corresponding branches for each of the 
moves in each of the information sets; and 
vi . a set X of outcomes and an asslgmrent f of an outcome f(x) 
to each of the end points x — or plays — of the tree* 

You will note how relations have played a role in this description: 
foremost as the game tree itself, but elLso as equivalence relations in 
the form of the player partition and the infoimation partition. 

In Chapter 3> vhen we have introduced the idea of utility, we will 
see how this complicated structure is translated into a far simpler 
mathematical structure which is much Ewre like some of the n^ximization 
problems with which you are familiar. 

2.7 ORIERINGS 

In addition to relations that partition sets - - equivalonoe 
relations — there is another important class of relatiaas, namely those that 
impose an ordering on the elements of a set. We have already mentioned 
several examples of such relations: inclusion among subsets of a given 
set, greater than or equal to among nxmibers, and not poorer th€ui among, 
say, suits of different qualities. We see that these three examples are 
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all like an equivalence relation in being reflexive and transitive, 
but they differ in not being symnetric . Que might be tempted, on the 
basis of inclusion and ineqml ity, to suppose that orderings are 
inevitably anti-syiiBsetilc, for if A C B and k ^ B, then we know that 
bC A is flalse. But "not Inferior to* raises some doubts abont this, 
for a person certainly can Judge two suits to be of the same qusQ.ity 
without concluding that they must therefore be the sas^ suit. Uiis being 
the case, we are led to the following 

Definition : Let E be a relation on the set A. R is called a 
qTjasi -ordering of A if it is reflexive and transitive* 

Note, according to this definition any equivalence relation is 
also a quasi -ordering, but, of course, the converse is not so. 

It seems reasonable to call a relation like "greater than or equal 
to" an ordering, since it orders the nimibers according to magnitude, 
but why the prefix ''quasi''? Not only relations like numerical inequality 
are encompassed by the definition, but also relations like set inclusion 
which do not manage to string things out in a single "line," Given two 
subsets, neither iwy be a subset of the other. OSiat is to say, two 
elements a and b may be incomparable in the sense that neither aRb nor 
bi?a holds. This is the reason we qualify the word "ordering" by "quasi." 
Another example: suppose that in scsae population we measure the weight 
and height of the people. Let denote the weight of person x and x^ 
his height. Define the relation "smaller than" over the population to 
be: X is smaller than y if both x weighs no more than y and is pq taller 
than y, i.e., x^ < y^ and x^ < readily verify that this is 

a qmsi -ordering of the people and that there may be pairs of people 
who are not compcxable, namely: those x and y such that x weighs more 
than y but is at least a short as y and those such that x is as light 
as y and is taller than y. OMs kind of relation can^ of course, be 
extended to more than two nimerical dimensions, each of which is ordered 
according to magnitude . 
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It is freq^ueutly convenient to dec<»apoae a quasi-arderiag into two 
separate relations. In the case of inegmlity into "strictly greater 
than" ana "eq\xal to." In the case of "preferred or indifferent to" 
into "strictly preferred to" and "indifferent to." Ponmlly, if R is 
a qiiasi -order, we define two relations P and I as follows: 

aPb if aRb and baa 
alb if aB) and bRa 



It follows directly from the transitivity of B that both P and I are 
transitive. Since R is reflexive, aKa always holds; hence ala and a^. 
Thus P is irreflexive and I is reflexive. Clearly, by the definition I 
is syimaetric and P is anti -symmetric . So, in smmnaiy, a qioasi-order 
can be decomposed in a natural fashion into a relation P, which is 
irreflexive, anti- symmetric, and transitive, and a relation I, which is 
an equivalence relation. 

It soroetimes happens that once we have decomposed a quasi-order into 
these two relations, we decide that we are willing to treat each of the 
equivalence classes induced by I as a unitary object. Hmt is, we are 
actually interested in the relation over the set having these equivalence, 
classes as its basic elements. OSiere is absolutely no difficulty in 
defining a relation which corresponds perfectly to P over this set, for 
if A and B are two different equivalence classes and aR> holds for soa« 
a e A and b e B, then for any a' e A and b' e B, a'Pb' also holds. This 
follows Imn^diately fram the transitivity of R. Thiis, for the equiva- 
lence classes we define a new relation, call it P a^in, as follows: 
APB if A = B or if, for a £ A and b e B, aPb. !Ehis new relation is like 
set "inclusion" In that it is reflexive, anti -symmetric, iud transitive. 
In other words, it is a quasi -relation which is alsp anti-symmetric . 
Since this special class of quasi -relations is quite important, we are 
led to the 



Definition : If R is an anti -symmetric quasi -ordering of A, it is 
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called a partial ordering of A. 



A peurtlal order is a l m o st the same as a qviasi -order except that we 
can conclude that a = b if both aTfo and hold; in a quasi -order t ae 
same condition only allows us to say a and b are "indifferent" -- which 
is to say, equal with respect to the property characterizing the order, 
but not necessarily identical elements. Set inclusion is a partial order. 

While some interesting orderings do not eLLlow us to make comparisons 
among all pairs of elements, others do. Exan^es: greater than or 
equal to, (optimistically; preferences people hold anrang commodities, 
etc. Presumably these are sufficiently important to be given a name. 

Definition : A quasi-order R on A is called a weak ordering of A 
if every pair of elements is comparable, i.e., if a,b e A imply 
that either &Sb or bRa or both holds. 



Definition : A partial order R on A is called a simple oi-dering of 
A (it is also called a linear ordering and a chain) if eveiy pair of 
elements is comparable . 

We note that a simple order stands in the same relation to a weak 
order as a partial order does to a quasi-order: the former in each 
case being anti -symmetric, the latter not. 

As we suggested above, if is a set weakly ordered by R^, 

weakly ordered by R^, , and A^ by R^, then it is always possible to 

induce a quasi-order on the product set A = A, X A^ X ... X A . 

12 n 

Formally, we do so as follows: Let x = (x^, x^, .., x^) and 
y = (y^^ y^) ^ a, then we define xl^ if and only if 

^iVl' -^2' •••^ ^ VVn- 
The most ffemiliar examples of this are when each A. is the set of real 
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numbers ordered by magnitude^ as was the case in oiir example. 



It is also always possible to induce a weak ordering on A, and in 
many contexts this type of veak order is i«portsnt. Roughly speaMng, 
what we do is order the n sets according to their "importance, " and 
then reqixire that a more important "dimension'' always have precedence 
over a less impoiii^ant one. Example; a military ccamnander cay have 
several courses of action, each of which will have repercussions in 
several quite different domains. He might evaluate them according to 
his potential for future action, the dasage inflicted on the enemy, loss 
of life among his own troops, and his personal ^in in prestige. If he 
Judges theee consequences to be of overriding importsuice in the given 
order, then he will always choose the course of action which makes his 
potential for future action greatest, but if they are all the same in 
that diiwnsion he will drop to the next and choose the one which resiilts 
in greatest eneiny damage, but if they are also all the same on that level, 
he will drop down to the next, and so on. A very Jfemiliar example of 
this kind of hierarch of dimensions is the ordering of words in a 
dictionary: the first letter governs the ordering except when two words 
have the same first letter, in which case the second does, and so on. 

In general a lexieograiMc ordering R of the product set A is 
defined as follows: 

xi^ if \\y2^ and ^i^^ 
or if Xj^R^y^ and y^R^Xj_ and x^R^yg ^ y2^2^2 
or .... 

To close this section on orderings, let us append a word of caution. 
Throughout mthematics orderings of the types discussed are so ubquitous 
and useful that one tends to get a little rigid about them. Eiis seems 
to be a particular probl€3a when it comes to formulating socially and 
psychologically interesting "orderings" surh as preferences among goods, 
or cc«parative quality of objects, etc. Much of the difficulty centers 
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in the aeBumption that a preference relation, say, is traiisitive* One 
feelfl, soiaehow, that if he prefers a to b and b to then he should 
prefer a to c. It is certainly a plaiisible norsaative statement for 
"strict preference, " but it is something else again for '"preference or 
indifference." For imposing transitivity in the latter case implies 
that we are supposing "indifference" is also transitive. It is doubtful 
if this is often so. Me have con^ back again to the question of dis- 
crimination which was first raised when the idea of a set was intro- 
duced, and large people do not, and in some sense cminot, discriminate 
perfectly. An example may si^ggest the difficulty with orderings. Most 
people would strictly prefer a cup of coffee with one luiap of sugar to 
one with five lumps. These same people, however, could be expected to 
report indifference between two cups which, no natter how much siigar 
they contain, only differ from each other in sugar content by a thousandtn 
of a gram. If so, then by taking a sequence of cups from one to five 
cubes in increments of a thous€uidth of a gram, we would have to conclude 
from the transitivity of indifference that the person is indifferent 
between one €md five cubes. As this is contraiy to choice, we have cast 
doubt on the widely used assunqrtion that indifference is transitive. To 
get around such dilemmas it is possible to introduce "orderings" in which 
P is transitive and I is not, but we shall not go into that here. 

Problems 

1- What kinds of relations are the following (prove your answers): 

a-let ''age" mean a person's age in years at his last birthday^ and 
let the relation be 'lii.s the same age as" 

b-less than one year's ^ference between birthdates 

c-at least as tall as 

d-let A be a set of cities in the United States, and let the re- 
lation be defined on A X A as the "the gi^ater distance between 
two cities in scheduled airline miles." 

2- Give significant industrial examples of a quasi-order, weak order, 
and a lexicographic order- 



3-Just before the definition of a partial order, ve sketched hov a 
qmsi -order induces a partial order on tt^ set of equivalence 
classes of the indifference relation, tfe asserted that the in- 
duced relation is transitive; prove ^Uiis. 

2,8 FUNCnORS 

!Qie intuitive idea of a faction is videspread and of the uts^st 
importance in almost all science. Essentially^ one means by a function 
a rule that assigns scaoething to each value of a variable quantity • For 
e^MBiple, if X denotes a real number, then the function f, vhere 
f(x) - x"^, is the rule that ctasigns the real nuniber x^ to each value x 
of the variable. In addition to such power functions of etlgebra, xnany 
comaon exaanples of functions are knovn from trigonometry and the calculus : 
the sine, the exponential^ the logarithm, etc. It is visually mde clear 
in the calculus that ve shall cftll any rule vhich assigns a real nimber 
to each value of a real-vali^d variable x a function. Of course, in 
practice attention is largely restricted to continuous functions, or at 
vorst to those vhich, like l/(l - x) and l/(l - x) x, have only one or 
two discontinuities. 

Historically, these are aiaong the earliest notions of a function, 

out diiring the l^h century the concept was broadened until now we have 

an exceedingly general and simple definition. Even in the calculus one 

begins to see the need to bioaden the concept. For example, consider 

the process of taking the derivative of a function. This can be looked 

upon as the assignment of one function, the derivative, to another. The 

cosine is assigned to the sine^ since d sinx = cos x. Thus if you take 

dx 

the set of differentiable functions as the underlying variable, differ- 
entiation assigns to each of these another function. This is very much 
like our ordinary idea of a function, except that real numbers are re- 
placed by real -valued "ordinary" functions. The sets vhich represent 
the independent and dependent variables are sets of functions, not the 
real numbers. But other than that, the notion is not very different. 
15ie integral, and many other operations with functions, can be viewed 
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require special treatment. 



Definition : Let D and R be t^'O (not i^cessarily different or 
disjoint) sets. A subset F of D X R having the property that for 
each d e D there exists at least one r € R such that (d,r) e F is 
called a function from the domain D into the range R. The set 

[r| r e R and there exists d € D such that (d,r) e P] 

is called the Imge of D under F. A function F is called single - 
valued if (d,r), (d,r' ) e F imply r = r' . 

For reasons which are partly historical and partly matters of 
convenience, certain special notations are used for functions which 
differ from the usual notation of a subset of the product of two sets. 
Historically, the early notions of a function axose and were widely 
employed long before this nrare abstract definition was evolved, and as 
a result different notations were introduced. Naturally, these are 
better known. In addition, many of the concepts one wishes to consider 
about functions can be iK>re neatly expressed in the conventional 
notation (see Chapter 3). Eiere are four, somewhat different, notations 
which we may mention. In these F is simply the name of the function 
which is given by tae subset F of D X R; this is not the first tin^ we 
have let the same symbol play two different, but closely related roles. 

1- F: D -♦R 

2- P: X -►F(x) 

3- X ^F(x) 
h-F 

But what of the most common notation of all, F(x); why is that 
omitted? It is true that this is the most comaon notation, but it is 
misleading and, in f^ct, incorrect. F(x) denotes the image of the 
point X in the doss in, not the whole function which describes how each 



point of D iB mapped into R. Ihe function is F. We uill avoid the 
notation P(x) for a ftinctiou. 



Hie re is a certain amount of terminology about functions which it is 
veil to have at one's finger tips. Scms of it has already been introduced 
and used: domain, range, image, and single -valued. We say that a function 
is onto R if its image is R; otherwise, or if ve don't know, we say it is 
iQto R. A function which is not single -valued is called laulti -valued , 
Actiially, BK>st often one just uses the word "function" to n^an "single - 
valued function," and prefixes it by 'teulti -valued" if it is not single- 
valued. There are a fair number of synonyms for functions, many of which 
have implicit conventions for their use. Among them are: mapping, 
transformation, and operator. 

Ihere is a perfectly trivial way to avoid ever having to 
work with multi -valued functions, but often this trick does not 
really buy anything. Suppose F is a multi -valxxed function from 
D into R. This means that P(d) is not necessarily a single 
point in R, but can be a subset of R. Bat, of coxirse, a subset 
of R is a single element in 2 , hence we can always treat F as 

R 

a single valued function from D into 2 . The reaion that this 
change is not always valuable can be easily illustrated. Sup- 
pose F is a real -valued function of a real variable defined as 
follows : 

X for X > 1 

F(x) = 

0 for X < 1 

At the point 1, F(1) ^ {0,1], To moke F single-valued, ve would 
then pass from the fairly simple range of the real numbers to 
all possible subsets of the reals, which is an extresaely compli- 
cated set having none of the neat and familiar structxire of the 
reals. This is an awful price to pay for being xirwilling to skirt 
about one obstreperous point in the dcmin. 
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Suppose that F: D and that D = X X then we say F is a 
function of tvo variables, une with domain X and the other vith domain 
Y. If d € D, then hy o\ir assumption about D, it has the form 
d = (x,y), where x € X and y € Y. Thus, F(d) = P((x,y)). Jtor 
simplicity, F((x,y)) is usually written F(x,y). If D is the product 
of n sets, then we say F is a function of n variables. For example, 
suppose X is the set of real nusibers, then we know that XXX denotes 
the plane. Thus, if F: X X X ->X, then F is an ''ordinary'' real- 
valued function of two real variables. Examples of such functions are 
F(x,y) = xy and G(x,y) = x + y. So we see that the familiar multi- 
plication and ar'dition of numbers can be considered as functions fl^^m 
the plane into the real numbers. 

Problems 



1- Bie set operations of union, intersection, and complementation 
are all functions. Specify the domain and range of each* Are 
they onto or only into? Are they single- or multi-valued? 

2- Prepare a list of five truly significant functions which are in 
one way or another involved in an industrial plant. Make at 
least two of them concerned with management problems . In each 
case carefully specify the domain, the range, and the function 
itself. 



2-9 SUMMARY REMARKS 

So far we have really done nothing; we have only introduced you to 
a batter/ of concepts which you have had to take on faith as being use- 
ful, Tb±B probably was not too difficult to do, since at least in 
special c^sea you have seen many of these notions before. Having this 
apparatus, we will be able to delve into its use in social science 
problems ir the next chapter. Qiere we shall be almost entirely con- 
cerned with the question of how to specify eind to find out about 
functions when their ranges and domains are different from the i^al 
numbers. In the course of doing so, we will work through simple 
versions of several problems which have proved important in the social 
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sciences . 

But before turning to these questions^ one point should be aade about 
the ground we have covered • A number of very general ideas have been 
introduced, including relations, orderings, and functions in this chapter. 
Yet in each case it turned out that we vere not required to introduce any 
nev basic ideas. Obce an idea was evolved, ve vere always able to foxmi- 
late its definition in terms of our more porlmitive idea of a set. Thus, 
our only undefined, priMtive idesis continue to be t^ose of a set, 
cleiaent, and belongs to (plus the rules uf logical inference). Every- 
thing else has been given ™>Hn1re in tersns of these primitives, flbla 
Mnd of econosay i? not only intellectually eleiaiant, but allows us to 
concentrate on a relatively few primitives if later «?y difficulties 
seem to arise • 

Let us turn now to the methods which have been evolved fcr working 
with functions. 
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CHAFER III 



AXIQMATIZATION OF HINCTIORS 

3*1 ITiTRODUCnON 

>iich mathemtical vork in science — be it physical or "behavioral 
science — is devoted to the isolation and investigation of functions 
fhich, for one reason or another^ are deexaed to be of interest. In the 
physical sciences the loa.lor, but by no tn^^nq excliisive, tools eire 
differential equations ^md their various extensions and relatives vhich, 
together, are called analysis. For the xoost part, these laethods caimot 
be carried over directly to the behavioral sciences "becaxise the basic 
behavioral variables — at least as they are nov viewed — are not 
numerical. The sir,,;le outstanding exception to this is econoinics. 

IMs observation must not be interpreted to B^an that the sets 
representing social and psychological variables are totally without 
structure; on the conti^jry, some structure is essential. But it just 
doesn't happen to \ hat of nusibers. Pbr isost of xis trained in the 
physical sciences, being deprived of our major weaj on analysis 
leaves us with a bewildered empty feeling, and we t^nd to flail beck 
upon non-mathematical approaches, relying on intuition and, all too 
often, prejudice when we have to think abo t problems where people ^re 
involved . 

15ae main pui^x^se of this chp^pter is to show that things are not 
nearly so black as they first seem and that what one is forced to do 
in the mathematization of behavioral problems is not, after all, so 
dilYerenv from what one does in physics* We shall begin by talking a 
bit about the definition of a few familiar functions^ for such defini- 
tions are not always well imderstood. After that we sbaH inquire as 
to just what one means by a differential eqimtlon and its solution. We 
will not be in the least concerned with solutions to particular 
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differential equations, but rather vith the meaning of a solution to any 
differential equation. Once this is understood, it will he more or less 
clear in principle how to extend thes»- saioe ideas to doaains emd ranges 
which are not numerical. However, to stop at that point would hardly be 
convincing or satisffeictory, and so the rest of the chapter is devoted to 
presenting a number of special cases with an eye to making this "in 
principle" extension fSar more concrete and meaningful. In each case, 
one or two very simple examples will be given to illtistrate the idea, 
and then in starred sections more ccsaplicated examples drawn from the 
behavioral sciences are offered. In order to keep complications to a 
minimum, we have son«times chosen fornnilations of these problems which 
are less general and less elegant than some available in the literature. 

I^t us stress again that there is a simple conceptual unity lying 
behind these examples, and that in turn there is a close conceptual 
though not techniced -- similarity between them and the analytic methods 
you know so well. The details of presentation should not be allowed to 
becloud the basic simplicity and power of the axiomatic n^thod. 

3-2 nEFINING FUNCTIONS 

In a way, all that we have to say in this chapter is implicit in our 
previous remarks about defining a set. Basically, a set must be defined 
via a property (sometimes presented as two or more properties for con- 
venience of statement) which its elements, and only its elements, satis:^. 
There are two special cases of this which we have singled out as being of 
a distinctive character, rendering them almost conceptually different- 
First, the elements of a finite set can be listed explicitly. Gecond, 
some sets can be defined as a "combination" (e.g., union, intersection) 
of previously defined sets. The very same comments hold for functions, 
since, as we have seen in the last chapter, they are nothing more nor 
less than a special brand of set --a subset of D X R. 

It will help, however, if ve explore the implications of this remark 
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much laore fully. We will first dispose of the last two special methods 
of definition, and then concern ourselves in the rest of the chapter with 
functions defined implicitly by lai^perties they eatisiy. !Ehe most 
fiamillar examixLes of flmctions presented explicitly are those gi/en in 
tabular or gra p hical, form. "Eables of the sine or the logarithm are ex- 
plicit listings of two functions. Oto be sure, only certain selected 
values of the function are tabulated and then only to a certain degree 
of accuracy, and one must interpolate to find other valu-s. The tabular 
or graphical presentation of experimental data aMJunts to the saiae thing. 
Indeed, any time the domain is finite, this method can be used, often to 
advantage. Tot maay theoretical purposes, however, it is not suitable 
either because it is not sufficiently coiapect or because, in idealizing 
the problem, we have chosen an infinite set as the domain. Actually, 
something cj.osely related to an explicit tabulation of a function is 
also possible when the domain is infinite, provided the image is finite. 
Example: 

1, if x is a ratiecal number 

f(x) = 

0^ if X is an irrational mxraber 

THIS function is given an explicit definition by relying on an implicit 
definition of certain subnets of the dcauain^ in this case the definition 
of the rationals and irrationals • Bais is often a ixseful trick. 

Definitions of new functions in terms of ones vhich are already 
knovn plus admissible operations (such as addition and multiplication) 
in the range and domain are ftuniliar- Ordinary algebra can be thought of 
as being built up this way. 

Another class of examples where new functions are defined in terms of 
old are derivatives and integrals of known functions. Sometimes they can 
be explicitly ejqn:^ssed as old functions^ e-g., 

d sin X 
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Other tines they cannot, as for example the elliptic integml 

/(I - k sin x) dx. 



Nonetheless, this integral is a well-defined function expressed in terms 
of an operation on an old ftjnction; for niaoerical work, one ustaally looks 
it up in tables . 

One very general, and useful construction of new functions fi^ old 
is the iteration of two or more functions . Suppose f is a function 
frcaa D onto R and g from K into S, i.e., 

f: D (onto) 
g: R ~»S 

We may now define a function h which is the overall effect of first 
mapping D into R via f and then R into S via g the iteration of 
g on f. Formally, h: D -*S is defined as 

h(d) = g[f(d)], d e D. 

It is cvetomary tc^ write h = g[f], or simply gf . A word of caution: 
suppose D = R = S = retkl numhers, then the symbol gf is ambiguous, for 
it could mean the iteration of g on f or it could mean the function H 
defined as follows : 

H(x) = g(x)f(x), X any real number. 

Usually, the context will differentiate between these two meanings . 

As an example of iteration, sup>xDse D - R - S - real nismbers, and 
f(x) = X and g (x) = log x, then 



sEfU)] = gU^] 

2 

= log X 

= 21og X 

= 2g(x). 
Note, f[g(x)] = f[log x] 

= [log x] ^ 
Thus, in general, f[g3 ^ g[f ]. 

Although defining nev runctions in terms of old is an extremely 
valuable and oftea not too difficult activity, it still doesn't ever 
get to the heart of the problem of defining functions. Somewhere that 
process must cease and one or more function^ have either to be given 
explicitly or implicitly. Son^times explicit definitions can be used, 
but for much theoretical work they will not do. This leaves us, then, 
with the mjor area of implicit definitions. The rest of -hapter 
is devoted to this. 

Problems 

1- Suppose f and g are defined to be 

f(x) = b^ and g(x} = log^x. 
What can you say about f[g3 and g[f]? 

2- In general, if 

f: D -»R (onto) 
g: R -»D (onto) 

have the properties 

g[f(d)] = d, for all d e D 

f[g(r)] = r, for all r e R 

we say f and g are inverses of each other. Show that a necessaiy 
and siifficient condition for a function f from D onto 1 to have 
an inverse is that for each r e R, the set 
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[dl d € D and (d,r) e f ] 



has exactly one eleioent. 



3-I«t D = {a,b,c,d) and R = {1,2,3). Suppose f: D ->R and 
h: B. ~*B are explicitly defined as: 



f(a) 



h(l) = b 



1 



h(2) = a 



f(c) 



3 



h(3) = c 



f(d) 



2 



Write out h[f]. Restricting f to the domain (a,b,c}, write 
out f[h}. 

3.3 SOME WELL KNCWN PROPERTIES OF ORDINARY FUNC?TIONS 

As vith sets, an implicit definition of a function is a list of 
properties which it satisfies and which specif^ exactly that function 
no laore, no less. Actually, in practice, we often find it convenient 
to discuss a whole class of functions, each of which possesses a given 
property. It may be worth reviewing a few of these. 

In analysis, a very prevalent assumption is that a function is 
continuous, or at worst that it has a finite maaber of discontl luities 
You will recall that, roughly, a real -valued function f of a rea2 
variable is continuous at the point x provided that "iriaenever y is a 
point "near to" x, then f(y) is also "near to" f(x). We will not 
attempt to make this precise which amomts to maVirig precise what 
we mean by "near to" — since we shall not use continuity extensively. 
A function is said to . continuous If it is continuous at every point 
X. This is a property vhJch may or my not be met by a function. For 
example, the function drawn in 

Fig. 21 and defined ao: 



Fig. 21 
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0, if X < 0 

f(x) = 

1, if X > 0 

is a step function with a single discontinuity at x = 0. While it is 
not continuous, each of its haJves are. This mkes it comparatively 
easy to work with. Not all functions have just a finite number of 
discontinuities, and so they are not all built up of continuous seg- 
ments. For exaople, the function f where 

1, if X is a rational number 

f(x) = 

0, if X is an irrational number 

which we mentioned before, is everywhere discontinuous. >fany of the 
functions for which you know "formulas" are continuoiis: e^, x^, sin : 
etc.; and others have only a finite number of discontinuities: 
log X where x > 0, l/x, l/(l - x)(l + x), etc. 

Another property which is frequently singled out i'* analysis is 
monotonicity whether a function is always increasing or always 
decreasing. Pbrmally, we say a -eal -valued function f of u real 
variable is monotonically increasing if x < y implies f(x) < f(y); 
it is strictly monotonically increasing if x < y implies f(x) < f(y). 

The step function of Pig. 21 is monotonically increasing, hut not 

2 

strictly. Fbr the domain x > 0, x is strictly monotonically in- 
creasing. There are parallel definitions for decreasing functions . 
A number of the important functions are neither monotonia increasing 
nor decreasing: the slue, x'" for all x, etc. 

In one sense, each of these conditions is fairly weak, for e-'ch 
defines ; Jarge class of functions having that property. But there 
iK some .narrowing down. If you think only of continuous functions, 
the sine is included, but if you stipulate the class of ccntinuous 
monotonia fuiictions, then the sine is loft o^'t. As more and more 
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properties are added, fewer and fever functions can be found which 
meet all of them until, finally, you may c^t down to just one 
function meeting theiu or, if you're not careful, to none at all. 
We ^11 come back to this, but first let us consider the question of 
generalizing -Ghese two properties to a broader class of functions. . 

Neitlier the idea of continuity nor monotonicity makes much use of 
the properties of the number system, which means that it should not be 
too difficult to make them meaningful properties for functions with 
domains and raiiges a good deal more general than the number system. Of 
the two, continuity is the more difficult to generalize, and as we will 
not need this generalization we shall do no more than say a few sug- 
gestive words about it, !Qie only term in our inforoial definition of 
continxUty which refers to properties of the number system is "near 
to." If we could abstract what we mean by this, then all sets having 
a ''near to'' structure on them would be suitable domains and ranges for 
defining continuous functions. Such an abstraction is possible, and 
it is known as a topology • Sets having a topology, i.e*, a concept of 
"near to'* defined on them, are known as topological spaces. 5o far 
topology has found little, if any, direct use in the attempt to do 

mathematical work in the behavioral sciences, so we will not enter 
Into it here. 



The generalization of monotonicity is much more important for our 
pin^XDses here, though it certainly is not nearly so important in 
mathematics in general. To define monotonicity, the only property of 
the numbers which was required was their ordering, which it will be 
recalled is a simple ordering. Thus, it is easy to see that the 
generalization can be made at least to those ranges and domains which 
are simply ordered. But if you look at the definition carefully, you 
will see that it neither mtters whether the ordering is strictly anti- 
symmetric nor whether all pairs of elements are compeurable or not. We 
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are therefore led to make the following 



Definition : Let y( be a quasi -ordering of the set D and ^ a quasi - 
ordering of the set A i\inction f vith doiaain D and range R is 
said to he order presei-ving if for every a,h € D such that a j( h, 
then f(a) ^ f(b), 

(Terminological note: Some authors use '^monotonlc'^ where we have 
used '*order preserving, " hut this is not vei^r common in the 
literature of applications to the behavioral sciences.) 

Order preserving functions are important for this reasron: the 
image of such a function reflects the order structure of the domain, 
and if one knows a lot about the image, then indirectly one also knows 
a lot about the domain* TSie ordered set we know most about is, of 
course, the real uiambers ordered by magnitude, and so it should not be 
surprising if at son^ point we attempt to map an ordered set arising 
out of a behavj^oral science problem into the real numbers. One such 
topic is known as utility theory (See Section 3.11). The real number 
system is not, however, the only ordered set we know something al?out 
(subsets under inclusion is another one), and so we should not be 
completely rigid about representing ordered system nunerically. 

3o far we have introduced only properties which are not very 
restrictive, and this is li'.able to be somewhat misleading. It would 
aipear that we would have to have very long lists of properties before 
we narrowed otirselves down to a single function. This is not true^ and 
to illustrate it we will examine two properties, each of which put on 
very much tighter clamps. Again, let us confine ourselves to functions 
whose domains and ranges are the real numbers . Suppose x denotes the 
level cf some physical variable, and f(x) some measuie of the response 
of a system when the variable takes on the value x. Similarly, f(y) 
is a measure of the response wlien the variable Las the \ralue y. If 
we know bcth of these quantities^ then do we also know the response 
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f(x + y) when the variable has value x + y? Not in general- But for 
some systems^ especially in some elementary parts of physics, the 
response to x + y is siniply the sum of the responses to x and to y 
separately, i.e. 



This is sometimes known as the ''supeiT^sition law." 

What is eq. 1? Well, first of all, in technical jargon it is 
called a functional eqLuation . Clearly it is an equation, but in 
contrast to ordinaxy algebraic eqmtions which it somewhat resembles, 
the unlmcwa quantity is the function f, not a number. Looked at 
another way, it specifies a property which must be met by those 
functions f which are said to solve it; it narrows down the admissible 
range of acceptable functions . Almost any function you can think of 
does not have this property. In ffeict, if you add to eq. 1 the condi- 
cion tiiat f be continuous, then it can be proved that 



where a is any constant. It is easy to see that the functions of 

eq. 2 do satisfy eq- 1; it is a little more difficult to show that they 

are the only continuous functions which do so. 

Eq, 1 plus continuity narrow us down to the functions of the 
siirpie family given by eq. 2. This is far more restrictive than any- 
thing ve have seen so f ai . It is easy to see how, by adding a third 
prtDperty, we can narrow f down to a sin^;le function- All we have to 
do is specify the value of f at some point different from 0, for 
example ; 1 f wc set 



f(x + y) - f(x) + f(y). 



(1) 



f(x) ax, 




f {x^ ) = f , where x ^ 
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then we see from eq. 2 



f(x^) = ax 




SO) 



a 



= f /x . 
o' o 



A unique function has been defined by three of its properties. 

As a second, and somewhat similar, example, suppose we consider 
those functions I with domain x > 0, such that 

1- f is continuous, 

and 

2- f(xy) = f(x) -f- f(y). 

In words, these are the continuous functions that map the operation 
of multiplication of positive numbers into the addition of numbers . 
Prom this you can guess that logarithms are included among the 
solutions. In fact, it can be shown (and will be later) that they 
are the only solutions that are continuous. If, in addition, the 
value of f is specified at any single point other than x = 1, then the 
base of the logarithm is specified and so the solution is unique. 

Ihe various properties of the logarithm which make it so useful 
and which give you the feeling that you can work with it in a way 
that is impossible with arbitrarily defin'><^ fuiicttons follow immediate- 
ly from the functional equation f(xy) = f(x) + f(y). Pbr example, let 
n 

us prove log x = n log x, where n is an integer. In terms of the 
"linknown" f, we want to show f(x°) = nf(x). The method of proof is by 
mathesatical inductio n . This method is often appropriate when you have 
a series of related propositions, one associated with each integer. 
One shows by direct verification, which is often trivial, that the 
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proposition is true for n = 1. Next, one supposes that the ther em is 
true for the integer n, and then establishes that this implies it is 
also true for the integer n + 1. These two proofs are equivalent to 
a proof that it is true for each n, for take any n, then the fact 
that it is true for 1 implies that it is true for 2^ that it is true 
for 2 implies it is true for 3, and so on until you get to n* For 
our functional equation, the assertion is trivially true for n =: 1, 
We suppose it is true for n, and attempt to show it for n 4- 1. From 
the functional eqimtion, 

= f(x) + f{k^). 

SubsUtwUng the induction hypothesis that fix^) - nf(x) we find, 

fCx"" ^) = f(x) + fCx"") 
= f(x) + nf(x) 
= (n + l)f(x). 

So, we have shown that you can get to some of the ordinary 
functions of analysis by an implicit definition in terms of their 
properties. Indeed, we would claim that this is the basic way such 
functions are defined, but the fact that they are very familiar and 
that you can use them easily in calculations tends to mask this. 
Anything you know about the logarithm can be derived from the two 
properties we have stipulated. For example, if you choose a value 
for the base -- a value of f for some x 1 — then it is possible 
to compute f for any other value of the argument. Ttxis, is, in fact, 
one way to prepare a log table. We are not, of course, denying that 
the logarithm can be shown to be equal to a number of other expressions, 
which in some contexts are taken as its definition. \>r example, it is 
well known that 

log X = ; . 
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Uto shcv this fma our definition it is necessary to show that the 
expression on the right is continuous (which is trivial since all 
integrals ore continuous) and that it satisfies the functional 
fequ^tlcn for the logarithm. Of course, it is extreaely useful to 
Imov that this integral and the logarithm are the same thing, and 
much of elementaiy me.thematics is devoted to such equalities. It 
amounts to showing that an implicitly defined function Bonstimes 
can also be defined as a ccaabination of previously defined functions. 

Problems 

1- In problem 2 of the last set you showed that a necessary and 
sufficient condition for a function f to have an inverse is 
that [dl d e D, (d,r) e f ] is a single element set for every 
r € R. Can you think of a simple equivalent condition (in 
terms of the properties defined in this section) when f is a 
real -valued function of a real variable? Trove your answer. 

2- Using only the property f(xy) = f(x) + f(y), show f(l) =0. 

3- Consider those real -valued functions of a real variable which 
satisfy the functional equation f(x + y) = f(x)f(y) and are 
not identically 0. Show f(0) = 1. Can you think of any 
function satis^lng this functional equation? 

i+-Use mathematical induction to show l + 2 + 3+...+ n = 

3.^ DIFFERENTIAX EQUATIONS 

Beyond a doubt, the nrast ^miliar way to get at functions of 
importance in physics is via dififerential equations. To nany, this 
method seems superior to all others. Certaialy, it is a field which 
has received intense study for several hundred years and many of its 
results have been reduced to handbook simplicity. Although such cfet ailed 
knowledge is very useful in practice, it has blinded some to the true 
nature of the method involved. We wish to discuss this method briefly. 

let us suppose, as an example, that we are interested in the 
number of radioactive atoms which l&ve not yet decayed at time t 
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assuming that we began with N such atcans at tine 0. Let this unknovm 
number of atoms be denoted by f(t). The first important thing to 
recognize is that we have no imnediate precise grarp on the ftinction 
f . Our intuition tells us that if H is very large, then we will not 
get into serious trouble if we suppose f is continuous. Rirthenoore , 
the very concept of radioactivity insures us tiaat f will be a 
acnotonically decreasing function of time, but beyond that we have 
little iaaaediate feel for f itself. The second important point is that, 
while we do not know f directly, we can say certain things about f and 
functions of f from physical principles. In partlciiiar, it can be 
shown that f has the property that its rate of change in time is pro- 
portional to its value, i.e., 

df 

•^T- = -kf, where k > 0. 
at ' 

It is well known that this differential equation is solved by 

f(t) = Aexp(-kt), 
where A is a constant. Now, introduce the initial condition 

f(0) = N, 
then we get Ihe unique solution 

f(t) - Kexp(-kt). 

All of this is trivial and very well known. But suppose you place 
yourself in the shoes of the scientist wLo first arrived at such an 
equation from some physical process (certainly not radioactivity, but 
that is of no matter). You know nothing of the theory of differential 
eqxiations, for it has not yet been formulated, but nevertheless you 
have posed this problem: to find those functions f of time which 



satisfy the follofving properties: 




f(0) N 



(Note: by writing the first eqxzation^ we implicitly impose the 
condition that it is meaxiingful, i.e., that f is everwhere differentl- 
able. It is well known that this implies that f is a continuous func- 
tion of time . ) Given this problem^ what would be the first question 
you would ask? If your suiswer is 'Vhat is the solution" or some 
variant of it, tben we doubt that you have really placed yoiirself in 
this early scientist's shoes. You know that there is a solution and 
you would want to find it. He, however, would not have known immed- 
iately from the two properties he had written down t-bat a solution 
exists. It is not, when you think about it, completely obvious that 
these two peculiar conditions are necessarily satisfied by any 
function f. Jtor instance, had he set up the problem to find those f's 
which satisfy 



then he coiild not have found a solution. 

No, his first task would be to assure himself that he had in fact 
Tposed a soluable problem --to show the existence of a solution. To be 
sure, he might do this by demonstrating that the exponential is a solu- 
tion, but what if he did not have any hint that this was so? It can be 
quite futile to try randomly one function after another. Rirthermore, 
he might realize that his was but a special case of a whole class of 
similar problems, and so he might be tempted to use indirect methods to 
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shav once and for all the existence of a solution for each number of 
the class of differential eqixation problems- In flact^ this is the 
reason that you don't have to worry about the existence of solutions 
to most of the equations which arise in physics and engineering. It 
has been done for very general classes of differential equations . 
Advanced courses in differential equations are very largely concerned 
with such questions. 

Once having established to his satisfaction that the problem posed 
is solvable^ then one might suppose that his next task would be to 
exprers the solution in terms of known functions. But again^ this is 
doubtful. £|y what stretch of the imagination could he suppose that 
there is only one function satisfying the conditions he has posed? 
QMs is not to deny that we know that there is only one solution to a 
first order linear differential equation plus one initial condition, 
but is it obvious from just looking at the two conditions? Thus^ you 
might expect that his second task would be to show that the solution is 
unique • Again, this is something which can "te done without knowing 
the functions which solve the jo^blem, and it can be done once and for 
all for broad classes of differential equations . It is because this 
has been done in the mathematical 3J.terature, and not because it is un- 
important, that the engineer and physicist need not be much concerned 
today with uniqueness problems. 

In any characterization of a function by properties which it must 
satisfy differential equations are one special case — the two 
questions of extence and imiqueness are of primary importance. In the 
applications of mathenatics to the behavioral sciences which we shall 
n^ntion, it will be necessaiy for us to deal explicitly with these 
questions^ for we do not have a comprehensive general theory of exist- 
ence and uniqueness of functions on which to ftULl back. Once we have 
done this, then we may vmnt to worry about describing the function in 
some other terms, dis is what a solution to a differential equation is. 
It is customary to say that we have solved a differential equation if 
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we can express the solution in the form of integrals of known functions. 
Outride that realm, the criteria for what constj.tutes an acceptable 
representation of a solution are ffetr vaguer, and a certain air^unt of 
Jud^aent is needed. In sosoe cases, we are satisfied with a dexnonstra- 
tion of existence. In others we need to have practical iwthods to 
find certain values of the function. 

To return to our hypothetical mathematicieui, once assured that a 
solution exists and having begun to worry about uniqueness, he might 
well conjecture that it is not uniqibs. Sucii a coxjecture would be correct 
if at first he only set up the differential equation without the 
initial condition. Any function of the fbrm Aexp(-kt) is a solution 
to the differential equation alone. Diis is, of course, well worth 
knowing, for -t tells you that all solutions are fundamentally the 
same shape and differ only by a scale factor. Put another way, the 
ratio of two different solutions to this differential equation is 
some constant. Not only is that a compact statement of the situation 
described by the eqxaation, but it also suggests the nature of the 
condition which has to be added to render f unique, 

Thtis, if you set up some properties to d^' scribe one or more 
functions and you find more rather than one, then the next thing to 
do is to try to find out how two different solutions are related to 
each other. Siis mear^ that you want to describe the transformations 
which map ci*^ ^olutir^ii into the others. Ideally, but not invariably, 
the class of transformations which describe how to go from one 
solution to the others has certain nice closure properties: any 
transforation from the class maps a solution into a solution, and 
any two solutions are related by one of the transformations in the 
class. In this case, the mathemtician's problem is to give a compact 
description of this class of transformations and of one of the 
solutions . 

In sixmmary then, our mathematician first working on this differential 
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eqixatlon problem vould have had to do the following things : 

1- shov that a solirtion to the "prohXem exists^ 

2- deterniine vhether it is unique or not, and 

3- if it is not unique, ascertain hov the several solutions are 
related to one another. 

Diere is nothing ahout these three steps which rests upon the fttct 
that his was a differential eqmtion problem • The saxoe questions are 
meaningful and important whenever a function is defined implicitly by 
properties which it must meet. As we shall see in the following sec- 
tions, some of the terminology is a little different when we work in 
a more general context, but the ideas are not different, 

3.5 AXIOMATIZmON AND INCONSISTENCY 

The first question when a function is implicitly defined in a 
context different fl^^m the real numbers is: what context? Ihe 
mathematical nature of both the dOTsain and range of the function must 
be described. Usually, this becomes appeirent from the verbal formu- 
lation of the problem in question and from the aims of the analysis. 
Nonetheless, it is an extres^ly important step which determines to a 
surprising degree the success or fBdlure of the effort* For example, 
it has soiMtir^s happened that an apparently intractable or very 
messy problem is made very much simpler by an appropriate change in 
the domain or the range. In any event, these two things have to be 
specified precisely at the outset. (By and large, in engineering 
problems both the domain and range are the real numbers and visually 
this is taken for granted without any comrr^nt.) 

Once that is done, then appropriate properties of the function 
must be specified, Without a doubt this is the most difficult part 
of the task. It is a subtle art, requiring both a considerable 
sophistication in mathematics and a perceptive understanding of the 
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physical or behavioral situation one is trying to abstract, ^felthelnatical 
experience is needed so that the problem fonnulated will lead to 
suitable and interesting mathematical results, and the substantive 
problem must be well grr.sped so that the mathematics reflects it 
rather than some other problem. The interplay between these two 
demands is most tenuous and only rarely is there a ftruitful union. 
For the traditional problems of physics, it now seems comparatively 
simple to set up such conditions, for there are the Known laws of 
liiysicB to be drawn on. So f^ there are precious few laws, or even 
hints of laws, in the non-physical sciences^ and one is forced to 
considerations which differ considerably from those used in physics. 
Among these are: unconfiamed or only partially confiiroed guesses as 
to the laws operating, assumptions as to the statistical independence 
of two processes, ethical and normative demands, and a priori demands 
on the nature of scientific measures . Some of these will be illustrated 
in cnir later examples. 

In any event, a list of properties of the unlmown function is 
presented. When speaking in the general context, these properties are 
known a$ axioms, and the set of them as an axiom system for the un- 
known function. The whole activity is called axiomatizing a function 
or giving an aj^ omatic definition of a function. While such terminology 
is rarely appleu to the mathematics of physics, we could say that the 
differential equation and its initial condition mentioned in the last 
section are each axioms which together characterize a specific exponen- 
tial function. 



!ISie first problem, as we said, to be posed of emy axiom system is 
existence: does there exist a function satisfying: aU the axioms. 
Again, in the general context, the lajiguage is a bit different. Often 
one does not speak of the existence of a solution to the axiom system, 
but rather of the "consistency" of the axioms. Also one speaks of a 
function "satisfying" them. If there is no inner contradition among 
the axioms, i.e., if there exists a function which satisfies all of 
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them siisultaQeouBly^ then the axiom system is said to be consistent > 
If they are contradictory, they are said to be inconsistent > 

A trivial exasssle of an inconsistent system: Suppose D = {1^?, 31 
ifi simply ordered by magnitude and R = {1,2} is also sijoply ordered by 
s^ignitude. Problem: to find any functions f: D -iH satisfying the 
axion 

if x,y € D and x < y, then f(x) < f(y)* 

It is easy to shov that no such function exists that the axiom is 
inconsistent (with the doimin and range) — for by tvo applications 
of the axiom ve have 

1 < 2 so f(l) < f(2) 

2 < 3 so f(2) < f(3) 

hence the range h^ three distinct points, contraiy to assumption. 

A less trivial example: When ve introduced the cone, rt^ of union, 

intersection and inclusion of sets, we drew some parallels vith ora^h^^ 

addition, multiplication, and inequality. Ve alresidy knov that the 

parallel is far from perfect, but it would be interesting to see how 

far it goes. ^Hie following problem sets up one of the simplest analogies 

that might be possible. Sujqpose U is a set with two or more elements, 
U 

D = 2 , and R = real numbers. To find those functions P: D such 
that the following axioms are met: 

1- if A,B € D and A n B =^ ()), F(A U B) = P(a) + F(b); 

2- if A,B £ D, F(A n B) = F(A)F(B); and 

3- if A,B € D and A 5^ B, then A C B implies P(a) < F(B). 

We claim that this axiom system is inconsistent* A proof goes as 
follows. From axiom 1, 
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P(U) = F(U U (j)) = F(U) + F(<J)), 

hence F((f) » 0. fbr aoy A e D, axiom 2 states 

F(A)= F(A n a) = F(A)^, 

so P(a) = 0 or 1. If A j£ axiom 3 implies F(a) = 1. Bat since U 
has tvo or oore elements, there is at least one subset A different 
from U and ftrom (j), so A C U and F(A) = 1 = F(U), vhich is impossible 
by axiom 3. Thus the system is not consistent. 

Although the first example was completely trivial, and the second one 
not veiy difficult, they both illxistrate the basic procedure involved 
In showing an axiom system to be inconsistent. Our next section is 
devoted to a more complicated and interesting inconsistent axiom 
system. It arose in welfEire economics, and it is interesting mainly 
because one does not at first suspect the axioms to be inconsistent. 

Problems 

1- In the last example, suppose ve drop axiom 2. What function 
satisfies axioms 1 emd 3? 

2- Let D and R be the real numbers, and f: D -^R. Show that the 
following three a^d.o^ls are inconsist^t: 

i.f(xy) = f(x) + f(v), 

li.f(x + y) = f(x)f(y). 
iii. f has at least two differetnt values, 
(Note: do not assume f is continuous.; 

♦3.6 TH3 ARRCW SOCIAL CHOICE PROBI£M 

Roughly speaking, the concept of a fair social decision is one 
vhich is Eirrived at by taking into account equally the preferences of 
each (adult) individual for the several alternatives that have arisen 
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or that are presented by the leaders of the society. It anK^imts to a 
rule that enables society to pass ftrom the "votes" of the individuals 
to a social decision, but not Jiist any rule . The rule must be "f)air; 
it mat "take Into account equally" the inferences of each of the 
individuals. !Che problem is to agree \^n vhat ve sk^an by "f^r." 
What properties characterize a fair rule? Obce ve have agreed upon 
that, then ve can investi^te mathemati cally those rules vhich satisfy 
these properties and ve can ask vhether particxilar rules in compon 
iise meet thrai. If not, then \rtiere do they fell and is this important? 
For example, the rule most consaonly used in Western societies is simple 
majority rule* Does it satisfy our intuitive ideas of jftiimess? 

Such problems have been discussed for some years in the 
literature of political science and velfare econcsoics, but not until 
19^ vas one foxinulated and attacked as a mathematical problem. Obis 
vork, and a sketch of the background of the problem, can be found in 
K* J. Arrov^s Social Choice and Individual Values, John Wiley and Sons, 
Nev York (1951) • Oils important book attracted a good deal of attention 
and resulted in not a IJlttle controversy and misinterpretation; as a 
result there have been a dozen or so jotumal publications on the problem 
since then. TSie formulation ve Jhall present^ vhich in many vays is 
simpler than Arrov's presentation, is based upon one of these papers: 
Weldon, J. C, "On the Problem of Social Welfare Functions,*' Canadian 
J. Econ/and Ppl, Sc., l8, I952, ^52-1^63, 

We begin vlth tvo knovn sets* First, the finite set A of m 
distinct alternatives presented to society. Second, the finite set I 
of n individuals composirig the society, vhich may be as small as a 
three-nan cOTimittee or as large as the vhole electorate of a mtion. 
We shall suppose that each of the individuals 'Votes'' on the altern- 
atives in A and these votes are entered into a '^chlne/' vhich vill 
be described belov, out of vhich comes the social decision. We must 
nov translate into mathematical terms vhat ve shall mean by 'Vote" 
and by 'Wichine . 
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We shall not mean by "vote" what you expect the selection of 
the most preferred alternative . Bather, we shall suppose that each 
person orders the whole set A according to his preferences. This gives 
a good deal more information about his preferences than Just- the selec- 
tion of his most preferred alternative, and it should be desirable to 
utilize this added information in one way or another when reaching a 
social choice. Now, what do we mean when we say he orders the 
alternatives? Vfe take this to mean that esch person rank orders 
them, i.e., he states which alternatives is most preferred (say, by 
ranking it l), which is next uwst preferred (by ranking it 2), etc. 
We will also allow him to report that he is indifferent between 
pairs of alternatives if he chooses. In terms of our previous termin- 
ology, the reported preference orderings will be weak orderings of A 
(see section 2.?). Ihus, fbr example, if A = (a,b,c,d), then an 
admissible preference ordering is for a person to say he prefers 
b to a,c, and d, a to c and d, and that he is indifferent between 
c and d. In other words, he rank orders them b,a,c - d. Hie follow- 
ing preference pattern, however, is not admissible: a is preferred to 
c and d, b to a and c, c to d, and d to b. It is not admissible be- 
cause it is a non-transitive relation: a is preferred to d, d to b, 
and b to a. 

On any given set A a nuniber of different weak orderings are 
possible, the number increasing very rapidly as the size of A increases. 
Nonetheless, we shall have to deal with all of the possible weak order- 
ings of A; let us call this set of weak orderings W. Chir supposition 
then is that each person selects exactly one element fJrom W, i.e., he 
votes in the usual sense of the word for j\ist one of the weak orderings 
in W, and this selection is fed into the "machine" for making ^social 
decisions . 

This leads us to the second question, what do we inea n by the word 
"machine" in this context. Whatever its detailed physical realization, 
it must have this property: for any selection of n weak orderings from 
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one by each Imdlvldual^ it ccmee up vith a social decision based 
upon thea. lhat is to say^ it is a function vhose independent variables 
are tiie veak orderings selected by individtukls ai^ vhose dependent 
variable is the set of possible social decisions. We oust make this 
more i^recise* 

firsts let us consider the independent variable — the donwln 
of this function. When the individuals each select a veak order — say> 
1 chooses R^^ 2 chooses H^, n chooses — ^en the vhole society 
has chosen an n-tuple (Rj^^Rg, . . .,1^), where each £ W. In other 
words ^ the vhole society has chosen an element from the product set 

/ = WxWx...xW(n tiiaes). 

Since each individual is f^e to choose any of the veak orderings of 

i .e . ^ any elesient of W^ the society as a vhole can select any 
element from the product set yt. 

Once society has selected an element from the product set ^ ^ 
then the role of the 'ln^chine" is to reduce this complex of information 
into some sort of decision about the alternatives in A. At the very 
leasts the machine must transform such an element of y into an eles^nt 
of W^ I.e., into a veak ordering of the elements of A. Thus, we take 
the range of the function to be W. Any function with domain ^ and ran^e 
W will be called a social function. 

In simnary, then, the frsmevork of our problem is this: A set A 
vith m elements and a set I vith n el^nents are given. W is the set 
of all weak orderings of A and ^ = WXWX...XW(n times ) . A 
function F: y ->W vill be knovn as a social function > for convenience, 
we shall denote by R the ^neric ordering selected by the social 
function F, I.e., 

R = F(R^,R^, * . *,P^) . 
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You will receai tiiat in section 2.7 we showed how any weak ordering 
K can be broken down into a "strict preference" ordering P emd an 
"Indifference" relation I, which were defined as follows: 

aFb if and only if al% and bRa 
alb if and only if aHb and bRa. 

If denotes a weak ordering, the corresponding P and I relations will 
be denoted by P^ and I^, 

Now that we have set up the general framework of the ja^blem, our 
next task is to arrive at conditions on the function P such that it 
can be called "ftd.r, " This will be most easily done by introducing an 
auxiliary concept defined in teims of P, and then stating the condi- 
tions of fairness in terms of this concept. We suppose that F is a 
fixed social function and we let V denote a subset of individuals, 
i.e., VC !• If a and b e A, then the set V can be considered decisive 
for alternative a against b provided that whenever all the members of 
V prefer a to b and everyone outside V prefers b to a, then society 
prefers a to b. Stated foimally, the subset V is said to be decisive 
for a Etgainst b if F has the property that if 

aP^b, for all i e V 

and 

bP^a, for all i € V 

then 

aR). 

We shall now formulate the four conditions of "flaimess," the last 
three being in terms of decisive sets. The first three are not partic- 
ularly controversial and will be relatively easy to agree upon, but 
the last one will require more discussion. 

Hie first axiom only requires that both the set of alternatives 
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and the set of people be ade«|uai^ly large to have an interesting 
probleis* 



Axiom 1. ^Qie sets A and I shall each have three or more eleoents, i.e., 

in > 3 and n > 3. 

The second axloaa simply says that whenever there is tmanimity in 
society between a pair of alternatives, then t^e social function shall 
reflect this unanimity. 

ATcioan 2. For any pair of alternatives, the set I is decisive. 

CXir third requirement of jOaimess reflects the generally accepted 
belief that there should not be a dictator — a person whose preference 
alone for one alternative over another commands socieSiy to have *h.e 
same preference. 

Axiom 3. If i e I, then {i) is not decisive for any pair of alternatives. 

•Die next and last condition will bear considerable more discussion 
before we state it, for it is much the strongest and most controversial 
of the axioms. Suppose the n weak orderings {R^, R^, ...,Rj^), one from 
each individual, leads to the social ordering R according to a given 
social function F. Let us now fbcus on two alternatives a and b, etad 
let us suppose that society prefers a to b, Hxe last assumption does 
not really result in any loss of generality, for we can always inter- 
change the labels on the alternatives. Within society, a certain set 
of people will have stated that they prefer a to b, another set that 
they are Indifferent between a and b, and the remainder that they prefer 
b to a. Among the other possible pairs of alternatives, each individual 
will have reported some pattern of preference, ^stion: should society 
ever change its preference for a over b if all the members keep their 
preferences between a and b, but alter some (or all) of their preferences 
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ajaong the other alternatives? Put another way, if the individiial 
preferences between a and b are held fixed, but those axnong other, 
irrelevant, alternatives are changed, should there ever be any chsirige 
in the social decision concerning a and b? 

The major arguiKnt for answering No is this: If the social 
decision between a and b also depends upon how individuals order the 
other aJltematives, it xoay well be worthwhile for an individual to 
misrepresent his true preferences in order to put extra weight on an 
alternative about which he feels strongly. Just how he should 
misrepresent his preferences in order to emphasise a particular 
alternative will depend upon the function P and upon the preferences 
expressed by the olJier members of society. Thus, one enters into 
the complex domedn of strategic considerations where decisions depend 
upon estimtes of what other individuals are going to do* ITd be sure, 
this is not a reaX objection when n is extreirely l,arge, but in small 
committees it can become a serious problem. ?ot this reason, it is 
ai^ed, the social function should have the property that it is 
independent of irrelevant alternatives . We state this formally as 

Axiom k. If, for some (R^^Rg, . , ,,1?^), F has the property that 

aP^b for i e V, 
bP^a for i € V, and 
aR), 

then V is decisive for a against b. 

Any social function satisfying eucioms 1 through k is called a 
social welfare function . Arrow's principle result, known as his 
impossibility theorem, states that there is no social welfare function, 
i .€., 

gieorem. Axioms 1 through h are Inconsistent ♦ 
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Proof. We shall siqjpose that a social velflwre function exists, and 
then shov that this leads to a contiBdiction. Specifically, ve shall 
use a "downward" laathematical induction, starting vith the set I, to 
ahov that there xoust exist a single element decisive set, vhich is 
contrary to axicsa 3. ^ do this, tvo steps are involved. First, ve 
imist ee ablish that the set I is decisive, but this is assured by 
axiom 2. Second, ve Bust shov that if there is a decisive set vith q 
elements, vhere 2 < q < n, then this implies there is a decisive set 
vith q-1 elements. Together, these tvo statements imply that there is 
a decisive set vith one element, vhich violates axiom 3. So to prove 
the theorem, ve need only prove the induction step. 



Suppose / is a set with q elements vhich is decisive for some 
element a against some element b of A, Let a be any eleu»nt of V^,. 
and define V , = V - {a) . V , ^ p since q > 2. According to 



to axiom 1, there is at least one element in A different from a and b; 

let c be one such. We vill nov shov that V , must be decisive for a 

q-l 

against c, vhich vill prove the induction step and so the theorem. 



Consider any n- tuple of veak orderings {H^,'R^, ...,R^) vhich include 
the folloving strict preferences: 



i. aP.b, bP.c and aP.c fbr i e 7 

i ' i i q-l' 

ii. cP a, aP b and cP b, 
iii. bP.c, cP.a and bP.a for j e V . 

Define R = fCr^jR^^ ...,R^). We claim that aPb and bRc. First, ve 

have assumed that V is decisive fQr a against b and ve have chosen 

the orderlngs R. such that aP.b for i e V and bP.a for J e V , so aPb, 

i 1 q J q' 

To ahov bRc, ve suppose this is not the case, i.e., cR). But observe 



that by choice of the R^, 



cP^b and bP^c, for i ^ cc, 
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hence according to axiom k this vould loean (a) is decisive for c 
against b. As this violates axiom 3^ ve must conclude that bRc. 



Since R is a weak ordering, aPb and hRc imply aPc . But, by 
choice of the R^, 

aP.c, for i e V and cP.a, for i e V , . 
i ' q-1' i ' q-1 

Thus, axiom k implies that V^_^ is decisive for a against c, as was 
to be proved. 



As we pointed out earlier, the truth of the induction step implies 
the existence of a single element decisive set, which is impossible . 
Thus, our original assumption that a social welfare function exists 
is untenable, and the theorem is proved. 



Many people have found this result disconcerting because they have 
been willing to agree to each of the foiu: conditions as necessary 
requirements of "ftaimess" and at the same time have felt certain 
that a "fair" machine (function) could be devised. Kie fact of the 
matter is that this is not so. Once convinced, some emotionally 
reject the whole process and head to other activities; others become 
intrigued with the question whether the problem has been unfortunately 
formulated and vrtiether some modificatioi might not result in positive results. 



Such research is currently going on and scms positive results have 
been obtained. Although we camot go into this work, the three major 
directions it has taken can be indicated. ISie first is to question 
the whole formulation of the problem in terms of weak orderings. 
Basically this anmunts to a total recasting of the problem. The second 
direction rests upon the empirical observation that in any given culture 
it is unlikely that all possible con^binations of preference patterns 
will ever arise. 13iere are usually str<5ng correlations among the veak 
orders registered by the members of the same society, and so in 
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practice ve ax« asking too sucb wben ve demand that F be defined OTer 
the whole of y. It viU generally suffice to knov F for sosoe 8uS>8et 
of yf. !Ibe tricky task is to choose a suitable subset : one that seems 
to include all cases i^eh arise empirically and^ at the saoe tlme^ 
leads to a nothsmatioally traotablo problosu There has been 

scHe success in this direction. 

!Bie third najor tact is to drop the condition of the independence 
of Irrelevant alternatives (axiom k). This permits the participants to 
enter into strategy considerations when reporting preferences, but in 
OBX^ contexts this does not really seem relevant or iioportant. However, 
it is not sufficient Just to drop axiom k. It must be replaced by 
some other condition, fov oae can easily inr^uce examples of ftuxctions 
meeting the first three axioms i^ch are impossible to consider "fair" 
social functions (see problems 2 ax^ 3 below). 

♦Rrobleas 

1- In a democratic society it is often claimed that majority rule 
is a "fair" method to reach social choices. The function F 
representing majority rule is defined as follows: 

aR) if and only if [i| i e I and aP^b] has more elements 

than Ci| i e I and bP^a]. 

alb if and only if these two sets have exactly the same 

number of elements. 

Arrow's theorem asserts that this function cannot be "flair" 
in the sense of being a social function which meets ftyinmn 
1 through k, Vb&re does it flail? Prove yoiur answers (examples 
of violations will suffice). 

2- Let n = 3 and let A = {a^^a^, -"f^^) . I^t S denote the weak 

ordering of A in which is strictly prefterred to a^, a^ to a^, 

etc. Let S* denote the converse ordering where a is strictly 

m 

preferred to a . , a^ , to a^ ^, etc . Let F be defined as 
m-i m-l m-2 

follows : 
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\' if \ S or S* 

Rg, if Rj^ = S or S* and 7^ S or S* 

^R^, if Rj^ = S or S* aad R^ = S or S*. 

Shov that F satisfies axioms 1, 2, and 3. 

3-Let F^^^ denote any function satisfying axioms 1, 2, aad 3 for 
a given A and n = 3 (^y laroblea 2, at least one such function 
exists). Shov that for the sasne set A and n >3, the function 

P^^^ defined belov also satisfies the first three axioms: 



P^^^(R3^,R2....,R^) =F^3^(Rj^,R2,R3). 



3.7 CONSISTENCY AND UNIQUENESS 



In general, one does not try to construct Inconsistent axiom 
systems, for one Is usually trying to get at functions which one is 
IKretty sure exist* Proofs of inconsistency serve primarily to show 
either that one*s intuition has been in some way fSaulty and that the 
axlomatlzation does not really capture what was intended, or that what 
people have been tal king about is non-existent. These are both 
Ijaportant services, but they give neither the author nor the reader 
the same constructive satisfaction as yielded by a positive result. 

To shov that an axiom system is consistent, two general methods 
are available. Either one can exhibit a function which satisfies 
the axiom system, or one can devise a proof which shows that there 
must be such a function even though one is not explicitly pcroduced. 
Simple examples of the indirect method are not easily cojae by; at 
least we have not thoi^ght of one. The direct laethod assimes one of 
two forms. First, the axioms can be manipulated in such a way as to 
derive a necessary mathematical form for any function satisfying 
them, and then it Is shown that this function (or functions) does in 
fact satisfy the axioms. It is important that this last step be 
carried out, for fro© an inconsistent set of g^y-f one can sometiirtes 
derive a necessary functional form, which nonetheless cannot satisfy 
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tbem. Tbere is a tendency to forget to laake this verification. 
Second^ a function oay be jroduced (uisually preceded by the pbrase 
"Consider -Uie fblloviog. . . ") and then it is shown that it satisfies 
the axicms. Often such Ametions are coazqplicated, and one vonders 
froan whence they 8|xzring. Usuclly, the author is bard pressed to say; 
be will have drawn up on hie mathwritical tocperience, or bad some 
insight into the problem, or tried other functions and gradually 
loodlfled them into the correct one, bu*^ above all, he will have had 
SQsae luck. There is no set of rules that can be set down. 

As an esmmple, sup^se the question ie raised whether the functional 
equation 

f(xy) » fix) + f (y), 

where f is a real -valued function of a real variable, has a solution. 
It vill suffice to produce one. Consider the function f, where 

-/V f X dt 
f(x) = / -^r . 

1 ^ 

Observe that if the change of variable u - ty is imde, then 



xy 



du 



y 



so 



fix) + f(y) = / 



aty 



du 



du 



y U \ U 



xy 



du 



f 

1 " 



f(^). 
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TbaiB, the given integral is a solution to the functional equation. 



In whatever vg^ exLsteenoe has beem established, cnoe it is dene then 
questions of uniqueness arise. For instance, is the solution given 
above the only one to that i\mctional equation, or are there others ? 
Hus answer is that there are others, but as we shall see they must 
be discontinuous. Rou^ily, there are tvo general procedures to 
establish uniqueness. One can sanipulate the axioms to dezdve the 
necessary form of the function, and if thj.a necessary form is uniqxie, 
then we know that if there is any function satisfying the aacioms at 
all, it must be unique. As we stated above, one mst actually show 
that the necessary form for the solution is in fact a solution. "Hie 
other method, which we shaU illustrate, begins with the assumption 
that there are two solutions and shows that they must actually be the 
same. One does not need to have an explicit representation of any 
solution tc the problem to use this methc^, which is often an 
advantage . 

Suppose f is a real -valued function of a positive real variable 
which satisfies the following axicMs: 

Axiom 1. f is contin'oous for x > 0, 

Axiom 2. f(xy) = f(x) + f(y). 

Axiom 3. f(x^) = f^, \*here f^ is a constant and x 0 or 1. 
■ ■ ■ ^— ' o o o o 

We show that f is unique. First, we show that any function 
satisfying axioms I and 2 has the property that f (x^) = yf(x), for 
any real and positive y. If y is an integer, n say, then trom section 
3.3 we know that f(x^) = nf(x). Now, suppose we let x = 2°, then 

f(x) = f(2") = nf(z). 
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■o 

f(z) - fCx^/"*) « i f(x). 
Thus, If n axul n are integers, these two results cGanbloe to show 

But it is veil Imam that if y is axiy reaa moibery then ve can choose 
iQtegers m and n such that m/n is arbitrarily close to y. IQius, by 
tbe continuity of t, it follovs that 

f (x^) a yf (x) . 

Nov, let us suppose that f and f ' ar^ any two ftmctions satisfying 
axioms 1, 2, and 3* We ^ov f « f ' . Any point x can be expressed in 
the form xb x^^ for sooe appropriate y > 0, so 

f 

o 

^0 

- 1. 

Bms, f »= f or, in other vords the functtm satisfying the three axioms 
is uniq;ue. 

OVo exaa^es of consistent axion systems which are satisfied by a 



unique function and which have arisen in the behavioral sciences are 
given below. Hxe derivation is given only in the first case. 

♦3.8 THE Iim)BKATION MEASURE 

A postwar develoju^nt that has attracted a good deal of attention 
is the flxathemtical theory of cOTaiiunicatioa» It arose out of 
electrical comnuni cation problems, where it has been widely used and 
elaborated, and its basic foiwulation is due largely to the work of 
Wiener and Shannon. A standard reference is: Shannon, C. E and 
Weaver, W» T3ie Mathematical theory of Ccmmuni cation, Itaiversity of 
Illinois Press, Urbana (1^9). largely because it really Is a (special) 
theory of statistical inference, it has had considerable impact outside 
the area of electrical conmiunication, especially in psychology. Ebr a 
fkirly comprehensive survey of both the theory and its applications 
to psychology, see; Luce, R. D., A Survey of the Oheory of Selective 
Infoimation and Seme of its Behavioral Applications^ ^technical Report 
No. 8 (revised), 19!?6, Behavioral Models Project, Columbia Uoiversity. 

We cannot go into any of the details of the theory here except to 
derive the mathematical form of the central function employed. Biis 
function is interj^reted as a measure of the ''average amount of 
infozmation transmitted'' by messages in a coinmuni cation system, where, 
however, these words have a meaning which, though r\*asonable, is 
somewhat different from c(^imK>n sense usage. The measure is often 
called the ''(average) amount of information transmitted," but the 
shorter labels "entropy" (because of its formal identity to the 
expression for physical entroj^ in statistical n^chanics) azxl 'Hincer- 
tainty" are widely used. 

Ck^nsider the following idealization of many ccmnuni cation systems • 
A set A of n alternatives is given, and from it messages are formed 
by successive temporal selections (with replacement)* For example, / 
might represent an alphabet and the successive selections are used to 
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fozm words and sentences . Such mesBsges are then transmitted through a 
coaamini cation systen, vhlch Involves certain iibyslcal components, to 
its destination. Let us consider the arrival of such a nessage from the 
point of view of the person (the destination) receiving it. He is rarely, 
if ever, certain what symbol he will next receive, for if he were com- 
pletely certain it would be pointless to transmit it. Ho Infoxnatlon 
will bo ocDveyed \ihm the receiver is able to paredict with oerta^tgr 
what he uHl reoeive* But cne should not jump troxa this to supposiag that he 
must be ccmpletely uncertain as to what he will receive. If the I^erson 
is sending the message in English, then the receiver knows a priori that 
the probability of receiving an "e" is a good deal lax^r than the 
probability of receiving a "z". Such taiowledge is known to everyone 
spsaklng English, and it is continually oaployed wl»n inferring the 
symbols sent via a channel i^ch Introduces sosae distortion, as in 
noisy telephone eosBmani cation. 

dus. In general, we can suppose that there is a known probability 
distribution over the elements of A i^ch descidbes the a priori 
probability that each is selected. Suppose that A = {1,2, ... n}, 
where the numbers are simply labels for the elements In A. Tbc 
probability distribution is then some set of nuoibers 

p(l), p(2), p(n) 

with the p r o p er ties 

p(i) > 0, for 1 = 1,2, .. n 

and 

p(l) + p(2) + ... p(a) « 1. 

But this is hardly enough to describe the statistical structure of 
most sources of messages. Tot exsmple, in any oiatiural language the 
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selectioos ssde are not independent of each other. You know In 

* 

English that if you receive a "q, " the probability is laretty close 
to 1 that the next letter will be "u',' even though "u" has a very low 
a priori probability of occurring. We will, however, ignore this 
observation and mahe the assuzoption that we are working with a sovirce 
In i^ch successive selections frcm A are statistically independent. 
OSiat is to say, the probability of selecting element i € A is p(i) no 
matter what has preceded it . No doubt this appear to be an excessively 
restrictive assisoption since it seems to eliminate all natural 
Tang u sffl ts from consideration, but in point of ftict it turns out that 
it is easy to extend the information measure for independent selections 
to non-independent selections, ^r example, if the dependence extends 
only to the iaaaediately preceding syxnbol, then we work with the Joint 
probability distribution p(i,j) defined over the product set A X A. 
But this is still a probability distribution over a set, albeit a 
special set, and so it will have been included in our study of the 
independent case. 

As -vre suggested before, no infomation can be transmitted if one 
of the symbols in A is certain to occur, i.e., if p(i) = 1 for soane 
i e A. Purthermore, as the symlxsls become more and more equiprobable, 
then more and more information can be transmitted. For e.icample, if A 
has only two elements, 1 and 2, and if the probability of 1 being 
selected is 0.9, then more information is tj^nsmitted on the avei^e 
than when the probability is 1.0, i.e., when none is transmitted. But 
suppose the ja^Jbability is dropped down to 0.8, then isn't it more 
revealing to receive the symbol 1 -toan if the probability had been 0.9? 
Extending this argument you see that for two symbols the wftviimnq 
intimation must be transmitted when each has probability 0.5, i.e., 
when they are eqiii probable . Is it suitable to take the probabilities as 
a measure of the information transxnitted? And if it is, what probabil- 
ity or combination of probabilities should we employ when A has three 



Words such as "Iraq" prevent it from being exactly 1. 
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or xsore elements? Since any proposal oae might loake vould seem 
totally ad hoc, one Is led to consider svasonahle properties fox such 
a measure of the average axooimt of Infoznatlon traasoltted and to see 
vhether or not this singles oat a particular measure. !Qils ve do. 

flr&t of all^ since v« are speaking of a measure, ve mean a 
function iriilch has the real nuxobers as its range. Second, since ve 
have spoken of It as a measure of the average amotmt of Information 
transaltted, ve presuaahly mean that we shall find a value of the 
function for each alternative and then take the average of It over 
all the alternatives In A. But each alternative 1 Is characterised 
by its probability p(l) of occurring, so the ftmction depends upon 
that. So the measure is a real-vali^ function f vith domsdJi the 
real interval troa 0 through 1. Alr^idy ve have made a very strong 
assumption, one which Is similar to the condition of the independence 
of irrelevant alternatives in the Arrow social choice probl«o. We 
have not only Bald that the measure of infozmation transmitted by a 
selection of the symbol 1 depends upon p(l), but also that it depends 
only upon p(i). The distribution of probability over the other 
alternatives is completely Irrelevant! 

Accepting this, ve now introduce three axioms, first, it seems 
plausible that if p(i) is changed only slightly, then the amount of 
infbnoatlon transmitted should also change only slightly (though not 
necessarily proportionately). Thus, ve Impose 

Aad-om 1. f shall be a continuous function of p(i). 

Suppose that two successive selections are made trcm A, say 1 and 
then Since ve have assumed that selections are s'tetistically 
Independent, we knew that the probEbllity of the Joint occtirrence 
of i and then J, (l,j), Is siisply given by the product of the 
probabilities of the Individual occurrences taken separately, i.e., 
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P(i,j) - pCi)p(j). 



Rirtiienoojre, given that the selections aufe independent, it seems 
piMisible that the total amount of information transmitted is sixaply 
the sum of tins aooiint trsnamitted hy i and the aii^unt transmitted by 
J. ISxie is reasonable only hecauBe they are Independent. Ue would not 
vant to say that the amount of infbxnatlon transmitted by (q^u) in 
English is very diffSerent ftxaa that transmitted by q alone -- certainly 
it is not as mxch as the e\m of q and u taken separately. But since we 
have assumed independence, it is reasonable to impose 

Axiom 2. f[p(i)p(j)] = f[p(i)] + f[p(j)]. 

Finally, In any measurement problem it is necessary to agree upon 
some unit in terms of which measurements are mde : centimeters for 
length, seconds for time, grams for mass, etc. In this field it has 
proved convenient to say that one unit of infonnation has been trans- 
mitted whenever a selection occurs between two equally likely 
alternatives. !Bie unit is called a bit . IQxus, we have 

Axicaa 3. f(l/2) = 1. 

TlKse three axioms should look ftuniliar, they are the ssioe as 
those we set up in the preceding section. So we know that there Is 
a imique f^mction satisfying them, which must be the logarithm to 
some base which is detezmined by axiom 3. It is easy to see that it 
is the base 2, i.e., 

f(p) = -loggp. 

Kow if we take expected valijes over all the elements in A, ve obtain 
Shannon's famed expression for the average amount of Information 
transmitted: 
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-p(l)log2p(l) + p(2)log2p(a) +... + pCnUoggpCn) = -2 p(i Uog^pCi) . 



In tero0 of thie concept and two othejrs — daannel capacity and 
noise — Shannon was able to prove sosae extreBsely interesting and very 
genexul theorems concerning the possibility of transmitting laessages at 
certfldn rates and with certain acciiracies. Rou^Hy, he gives a precise 
mnaer lcal n e an in g to the intuitive idea that we can trade acciiracy for 
speed and conversely, but we cannot enter into these questions here. 

Before ending this section, we should o^ntlon that Shannon's 
original derivation of the measure is a good bit store elegant that this 
one, and it is correspondingly more dlfflciat. The xaain difference Is 
the choice of domain for the laeasure. He began with a function defined 
over probability distributions, i.e., a function H having a typical 



Be did not suppose, as we did, that H can be expressed as the expected 
value of some function defined in terms of tl» probability of an 
individual element being selected, tether, he gave an axiom system, 
which is somewhat similar to ours, for H from which he was able to 
derive that E naist be the expected value of ths logarithm of the a 
priori probabilities . 

•Problems 



value 



E ^(1), P(2) 



P(n)]. 



n 




i=d 



i. p(i) = l/n, for i= 1,2, . ..,n. 

11. p(l) = 1, p(l) = 0, for 1 = 2,3, ...,n. 

(!Iliese two values can be shown to be the "w-^ti^iTO and minimum, 
respectively, of the infbrraation measure when there are n 
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alternatives . ) 

2>In the same "20 questions" ox» su|rposedljr can Isolate .jxy 
"thing" in 20 binary (yes -no) questions or less. . If this is 
so^ what is the oaxisnim possihle mmber of "things?" 

3 -Suppose that A is a set of n elements vith a given probability 
distribution p(i), i c A. Suppose ve fozm a single long message 
by making sizccessive independent selections ftrosa A. Let p denote 
the probability of this siessage and let N, where N is very large ^ 

logpp 

denote its length. Show that — = — is approximtelj equal to 
n 

£ p(i)l«32P(i). 

i=d 

♦3 .9 THE SHAPIBY VALtE OF A GAMS 

As background for this section you should reread section 1.9 on 
Legislative Scheoes, particularly the last two pages. You will recall 
that we stated, but did not demonstrate, that for gaiocB (conflicts of 
interest) with n players it is possible to calculate a plaiisible 
measure of the "strength" of each coalition (= subset of the set of 
players). Let U denote the set of players. OSien, oatheioatically, 
coalition "strength" is a function v,with domain 2^ and range the real 
raxBSoerBf that satisfies two conditions, namely: 

i. v((tl) = 0, 
ii. if A,B C U and A and B are disjoint, then 
v(A U B) > v(A) + v(b). 

Such a function Is known as the characteristic function of a game. 

Most, but not all, of the present theory for games with n > 2 
players is based entirely upon characteristic functions, and so it 
is really quite iasasterial exactly how they arise from the original 
fonoulation of a game in extensive form (see Section 2.6). Indeed, 
ve shall make no verbal distinction between a game and its character- 
istic function, and ve shall speak of the game v vhen ve actually 
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Doan the gwae with chasaeteristic function v. In this section ve 
shall he concerned with a priori measures of individual power for 
gaaea in characteristic function foam. 

Bie problem ve shall describe vas both raised and solved by L*S« 
Shapely in *! valoe for n-persA gams*, Oontributions to the 
Theoiy of Games. II (H. V. Kuhn and A. W. Tucker, eds.). Annals of 
MathomticB Study a8, Princeton Ifaiversity Pt«SB, 1953, 307-317. An 
interesting and easily understood application of the Shapley value 
to legislative schemes is fouzid in ^pley, L. S. and Shublk, M. "A 
Method for Evaluating the SLstribution of H>ver in a Ccsoidttee System,** 
Aner. Pol. Sc. Rev.. kQ, 1$^, 787-792. 

Sup. ' £ that you are to be a player in a game (described in 
characteristic function fozn) which you have not participated in before. 
You cannot know exactly what will happen in the play of the game, for 
that depends iqpon decisions of other players as welX as yourself, 
(ionetheless, it would be surprising if you did not have soaae opinions, 
based entirely upon the structxxre of the game as described by its 
charactexdstic function, of its a priori worth to you. Star exai^ple, the 
legislative scheme in which a coalition is winning only if you are in it 
is surely worth more to you power-wise than the sctoae where any 
coalition having a majority of the players is winziing. The problem is 
to make such subjective "evaluations both explicit and precise. "Frcm 
what we have said, the evaluation must depend in some manner upon the 
set of numbers v(a), where A C «3^t what function of the character- 
istic function would be areasonable "to select is not, on the f^oe of it, 
obvious, and certainly any ad hoc definition would be questioned and 
countered by other suggestions. So we are driven once again to employ 
the axiomatic method. Itollowing Shapley, we shall list three apparently 
weak conditions from vhich it is possible to derive the unique ftmction 
which satisfies them. We will not ewstually carry out the proof, but we 
will state the result. 
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Ve start out with the idea that player i*s evaluation of a game 
V is a real number which depends upon the characteristic function v. 
TbAt is, for each player i ve will have a function with domain the 
set of all possible characteristic functions and raj2ge the refill 
numbers. !ISie quantity (j>^(v) will be known as the value of the game v 
to player i. 

Since the mmbering of the players is arbitrary, we may always renvnn- 
ber them in any way we like by a penaitation of the original numbering 
system. lIMs will cause the characteristic function to look different 
even thoiigh it represents the same underlying game, but, since these 
are only notational differences, players who correspond iinder the 
relabeling should have the same value. So Siapley's first conoition is 

Axian 1. Value shall be a property of the abstract ^axas, i.e., if the 
players are permuted, then the value to player i in the original sams 
shall be the same as the value to the peroiutation of player i in the 
permuted g^uoe. 

If U is the set of all players, it is easy to show (using condition 
ii of a characteristic function) that no coalition has power in excess 
of v(U). Thus, in a sense, this is all the power available in the 
situation for distribution among the players. Now, although each of the 
players is evaluating the gasie for himself, his expectation must 
reflect in large part what the other players can rightfully expect. We 
%rould hold that if these a priori expectations totaled to more than 
v(U'>, then surely at least one of the players must be over-evaluating 
the worth of the game to himself. SiMlarly, if the sum of the 
values is less than v(U), -Uien in a sense there is some under-estiusition 
of the a priori worths . Doe second argument is much less convincing 
than the first, but let us accept it and so iinpose 

Axiom 2. Pbr every ^me v, 




<}'l(v) + ^^(v) +...+ ^^iv) =v(u). 

Next, consider a player i who is porticipatixig in two different 
gaaes with characteristic flinctions v and say. He has an 
evaluation for each of these ^mes: $^(v) and <^^(v). Now, if we 
could think of these two games as heing a single game, let us t it 
u, then he would have an evaluation t^^(u), hut since we assume that u 
is but a renazaing of the two given games, we should have 

♦^Cu) = $^(v) + (t)^(w). 

The next thing to consider is whether we can treat the two games 
as a single one. Let us suppose that v is a game over th" set of 
plG^ers H and that w is a gome over the set S. While in ovac preceding 
discussion we assumed that R and S overlapped, at least to the extent 
of player i, we shall now be more general and suppose that they nay or 
may not overlap. It is a trivial matter to extend both v and w to the 
set of all players, R J S. If A is a subset of R J S, we define 

v(a) = v(R n A) and w(A) = w(S n A). 

Hiis is to say, in the game v, a coalition A has exactly the strength 
given by those members of A who are actually in the game, i.e., those 
who are in Rj the menibers from S who are not in R contribute nothing. 
Now, the two games are defined over the same set of players. Consider 
what ms^ be called the sum of the two games, denoted by u = v + w, and 
defined by the condition that if A is a subset of R U S, 

u(A) = v(A) + w(a). 

It is easy to see that u is a characteristic Amctlon, and so it will 
serve as the single ga*ne representing the two given ones . Qsus, the 
third condition imposed by Shapley is 
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Axlon 3» If V and v are two Qoace and if v + w is defined as above, then 



$^(v + w) = l^^(v) + $^(w). 

!Cbe last asciam is not nearly so innocent as the other two. For, 
though V -I- V is a gaae cooqposed from v and v, ve cannot in general expect 
it to be played as if it vere the two separate gasoes. It will have its 
own structure which will detenaine a set of equilibrium outcojoes which 
aay be very different from those for v and for w. lEkierefore, one might 
very well argue t> >t its a priori value should not necessarily be the 
sum of the valuei 5f the two coo^nent games. This strikes us as a 
flaw in the concept of value, but we have no alternative to suggest. 

If these three axicsss are accepted, then Shapely has shown that 
one need not — dare not -- demand more of^ value, for they are 
sufficient to deteimine (j>^ taniquely, and, indeed, one can obtain an 
explicit formula for it, namely: 

^Ay) = L 7(s) [v(S) - v(s - U})], 
S ^ 
S C U 

where s is the number of elements in S and 

7^(s) = (s - i}:(n - s):/u: . 

Let us examine this formula in detail. It is a sunaaation over all 
subsets of the set of playears, with a typical teim consisting of a 
coefficient ■«^ich we shall discuss presgntly — multiplying 
[v(s) - v(S - {i))3. If i is not a member of S, then S - (i) = S, and 
so the term becooKss zero. Thus, the formula only depends upon those 
coalitions involving i. It amounts, therefore, to a weighted sum of 
the incremental additions made by i to all the coalitions of which he 
is a member . 
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'So return to Hhb coefficients — the weights -- any one who has 
dealt at sOl with siiaple probability^ xiK>dels will recognize them as 
very fbailiar. Suppose that we build up rasdosn coalitions by chcK)sing 
a player at random trcsa. all the playvrs^ a second at random f^rcm all 
the raining players, and so on. Keep track of player 1 and when be 
is added to the randcn coalition, calculate his incremental contribu- 
tion to it. It is easy tc show that the probability of his being 
added to S - (i) is exactly 7„(s). !I!bus, the value of the gane to 
hia is eq;ual to his expected inersDental contribution to a coalition 
under the asstmrption that coalitions are fozioed at random. 

* Probl«as 

1- Suppose n s 2 and that 

v({l)) = - t({2}) and v({l,2}) = 0. 
calculate <t>2^(v) and (fgCv). 

2- Suppo6e n = 3 and that 

v({l)) = v([2)) = v([3)) =0 
v({l,2}) = v(a,3}) =v(C2,3)) =v((l,2,3)) =1. 
O&lculate i = 1,2,3. 

3.10 NON-UNIQUENESS 

A consistent axiom system for a function does not always single out 
a unique function, and somstlmes there does not seem to be any 
acceptable way to add another axiom to arrive at a uniqiie function. 
Non-uniqueness is hinted at if all plausible attempts to prove 
tmiqueness f&H, but this is not conclusive. Basically, there are 
two ways to prove non-uniqueness: first, and much the most common, 
is to exhibit two different functions satisfying the axioms, axxd 
second, is to prove that uniqueness would lead to a contradiction. 
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Sie several solutions to a non-unique axion systen may be so 
diffSerent tram one another that little can be said about tbeir 
relation to each other, tfe Taunr, for exnaple, the whole ftunily of 
logMTithBS (i.e., logBTitlms to difflerent bases) satisfy the 
Itinctional equation f(xy) ■ f (x) + f(y), and that they are the only 
solutions if f is continuous . But if ve do not stipulate continuity, 
sBny other discontinuous solutions exist and there is precious little 
that one can say about their relation to one another and to the 
logarlthaiBfi . In such ^uses, one tries to avoid the resulting confUsion 
by adding other axioms, such as continuity, so that a fairly coherent 
fhaily results. By "f&trXy co^rent" ve mean that a simple description 
of the vhole fiunily can be found, fbr instance, the ftuxiily of logarithms 
to different bases caxi be described by giving one wsrabeT of thie Aaxoily — 
the logarithm to a particular base — and by noting that any other laexnber 
of the faiolly is obtained by multipOLying it by a positive constant, de 
last statement fOllovs fjrom the veil knovn i»operty 

log^x = log^a logg^ac. 

Similarly, as ve pointed out earlier, the several solutions to 
the differential eq[uation 

dt "-^ 

differ from each oti»r only by a constant. 

Oat should not get the imi^sslon that it Is alvays possible or 
desirable to introduce anoti^r «^y1"aq to restrict the f\inctlons to an 
eMily described class. ¥ot eximple, in section 1.9 ve stated the 
tvo conditions characterizing tl^ cl¥iraeteristie 2\mctlons of n-peruon 
gazaes. It turns out that there is no sis^e description of the set of 
all ch&raeteristlc functions, but ve surely do not want to add more 
coiidlt'*ct;3 . Bie tvo conditions for characteristic functions arise 
Trm cor ilderations in game theory and they are the only ones vhlch 
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can be derived, so ve must live with theia. 

One also should not get the linpression, vhen a ftmily of solutions 
can be easily described, that tlie only class of transformations are 
constants, as in tbe tvo exaaples sbove. lu the next section ve vill 
present tt» axlons fbr linear utility functions, and it vill be shown 
that tvo solutloxxs u and u' of the axloa system most be related by 
vhat is knovn as a positive linear transforation, i.e., there are 
constants K and L, vhere K > 0, such that u e Ka' + L, And in adapter 
k, vherc ve discuss the axlooatization of nath^aatleal sys'tetos, ve vill 
be concerned vlth still another class of transfomatlons . 

Very little gexisral advice can be glwn as hov best to choose 
axloos 80 that the vhole ciass of solutions can be easily described or 
hov best to find a description of that class. Experience indicates 
that it is often possible to fOnnulate problezos v^se solutions have a 
coaapact description and that such probleas are of interest, but little 
of the experience in doing this has been neatly suiomaris^d, even as 
rules of thumb. 

*3 .11 THE NON-imiQUEHESS OF LIHEAE UTILITr PDNCTIONS 

^Oxe preferences of individtuds, organizations, and industries play 
an important role In all behavior and, therefore, are bound to be an 
integral part of any behavioral science. Fbr exaiople, in any conflict 
of interest (the mathematical model being a game) each participant is 
confl*onted by decisions to be made, and, depending upon which are 
actually made, certain consequences result. A unique pure consequence 
vill not necessarily arise from a given set of decisions, for there 
may veil be probabilistic elements in the situation vhich together 
vlth the decisions made by the participants determine the resulting 
pure consequence. So, from the point of vlev of the pEurtidpants, a 
probability distribution over the pure consequences is the normal 
result of a set of decisions, but that too can be considered to be a 
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consequence. In any event, it is the conse(3.uenceB, not the declsionfl 
tbcoaselvea, which xaatter to the pairticipsats and about vhich they have 
preferences. Of course, they vill try to argue teek ftron their 
pseferencee asong the eonseq^encea to the appropriate decision* to 
achieve preferred outccnes^ and indirectly this indnces a preference 
structure over the decisions. This haclorard inference and the problea 
of idiieh decision is ax^ropriate for getting vhat one prefers is what 
gsae theory is about. 

Inferences are relations; given two alternatives a and b, then 
either a is preferred to b, b to a, a is indifferent to b, or they are 
not coBparable according to preference. But it is noxie too easy to 
vork directly vith relations, and certainly our theoretical powers 
would be vastly augaented were we able to cast them in a nunerieal 
ftraiDevork, thus putting at our disposal xsuch of ordinary matheoatics. 
So, we are led to inquire whether there is any plausible way to assign 
nsBsbers to the elements of a set A of alternatives in such a way that 
numerical nagnitude reflects a person's preference relation > over A. 
IQxat is, if a e A and we assign u(a) to a, then we would want these 
numbers to have the property that a > b if ax^ only if u(a) > u(b). 
In more foxmX texmlnology, we would like to find a real -valued flmction 
u with domain A which preserves the ordering > on A. See section 3.3 
for the definition of an order preserving function. 

For one important set of alternatives this is trivial to do. If 
a person is offered two sums of money, it seem safe to suj^se that 
he will prefer the larger (other things being equal), and so the 
numerical magnitude of money serves very well. But most alternatives 
do not allow such a trivial assignment — consider preferences among 
the several drinks offered at a party, or aiming autooobiles, or 
women, etc. Actually, in these latter examples the trouble is not 
really in assigning nunbers, for that can be easily done if the 
preference ordering is a weak ordering (see section 2.7), but zrather 
that it can be done in so mcuiy different ways. Observe that if A is a 
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jfinite sraakly ordered set and u is a real -valued order preeervlag 
ftiaction vith dicmd.n A, then any strictly increasixig xoonotonic 
flmction (see section 3.3) iterated (see section 3.2) on u is also 
a real-valned order preserving function with dosBaln A. ISms, there 
l8 an Infinity of real -valued order preserving functions. Rirther- 
xBore, It Is not difficult to ohov that the only pcroperty of numbers 
vhlch is held fixed under such tranefbrmtlon is ordering; -tills 
zaeans that ve cannot use any of the ordinary properties of nustibers 
other than ordering. In effect, then, it is pointless to replace 
the given weak ortering hy a nuaerical f\mctlon. 

Indeed, the hlstoiy of the utility concept in economics suggests 
that it was a good deal worse than pointless to Introduce utilities 
in this f)ishlon. [Qiere vas so macih misuse and Bisunderstandlng that 
this concept of utility vas pretty thoroughly discredited. 

Another strand of the history of the utility idea traces back to 
early work, arising largely ftxm the needs of gamblers, in jarohability 
theory. In essence, the utility prohlem vas this: suppose you have 
assigned the utility u(a) to alternative a and u(b) to alternative p, 
then what utility does a ^tnble f^se outcomes are either a or b have? 
Let us denote by acjb the folloving gamble: a chance event (such as 
throwing a six with a die) has larobability a of occurring and probabil- 
ity 1 - a of not. If it occurs you receive alternative a, if not you 
receive b. Thus, boa means that you receive b with probability a and 
a with probability 1 - a. With this interpretation, ac4> and b(X - a)a 
mean exactly the same gamble. The question now is whether you can 
express the utility of the ^^unble, u(aCft)), in terms of u(a), u(b), and 
a so that it correctly reflects preferences among gambles atif^ pure 
alternatives (which are, of course, e special case of gambles). 

In the traditional jumbling situations, the alternatives are money, 
and, as we said, it is plausible to take the utility of a sum of money 
to be its numeri«»l value. So, in this context, acab means you get $a 




vith p(POl»bllity a aad $b with probability 1 - a. Either a or b 
or both any be neg&tive nuaibers, vhich means you lose that sum. Ifow, 
if the gaable aob is repeated a large maaiber of tines, one can expect 
an average return per gaaible of aa 4 (l - a)b dollars. This appears 
to be a suitable index for the vorth of the gaaible. Or does it? 

Consider the fbllowing probleia, due to Bernoulli, which is known 
as the St. Retersburg paradox. A fair coin is tossed as aany times as 
necessary for a head to appear. If the first head appears on the 
toss, you receive 2^* dollars. Since you inevitably receive some money, 
the person running the ga&e mist charge a fee for each play. Ration: 
how large does the fee have to be before you will be lanrLlling to pay 
it to play the game? According to our preceding discussion, this should 
depend upon your expected winnings in the gsaie. So let us compute these. 
Bie probability that the first toss is a bead is 1/2, in which case you 
receive 2 dollars; the probability of a tail on the first toss and a 
head on the second is (l/2)(l/2) - l/k, in i^ch case you receive 
2 « If dollars; the probability of tails on the first two tosses and a 
head on the third is (l/2)(l/2)(l/20 - l/Q, in which case you receive 
2^ » 8 dollars; etc. Since each of these possible outcomes is inde- 
pendent of the others, we cogs|)ute the e .pected winnings as 

2(1/2) 4- Hl/k) + 8(1/8) +...+ 2°(l/2^) 4-... = 1 + 1 + 1 + , 

which sums to no finite amount. In other words, you should be willing 
to pay any finite amount, however large, to participate once in this 
game. But this is silly. 

Bjere app^ur to be two possible flaws in the argument that leads 
to the St. Petersburg paradox. Eirst, we assumed that the worth, or 
utility, of money to a person is meas^Etred by its nunerical value . 
Ihere is considerable evidence, including subjective considerations, 
to suggest that this is fklse. Second, we employed an argument based 
on many replications of the gaaible to Justliy evaluating it in terms 




-131- 



i 



of Its expected monetary return, and then ve used this sane evaluation 
vhen the ^tmble occmrs only once. In other words, vhlle the long xvn 
argument probably mskeB eense for a gasibllng house, it mey not for the 
individual ^uabler playing only a fev tlaes. Another indication that 
Bonetary expected values do not repcresent the siibjective vorths of 
gas^bles is based on the foXlovlng observation. Consider ga&ibles of 
the fblloving fozn: yau win a fixed amount x if a flair coin casnes up 
heads and lose the same aaount x if it eoaes up tails. All such 
gaaiblefii have the same expected return, namely: 0. But would you be 
indifferent between one where x « $0.0^ and one where x » $1,000? 
enviously not. 

So, we nay want to drop either the assiraption that the utility 
of money is equal to its numerical value or the aseimption that the 
utility of a gamble is given by the expected value of the utilities 
of its components or both. Of the two, we are imich more willing to 
drop the first than the second, especially since it only applies to 
money anyhow. Pbr non-monetary outcomes we have the task of assigning 
nu m b ers and so we might Just as well extend this problem to include 
nK)netary outcomes . But once we admit that the utility of money may be 
different Trom its numerical vuliies, then the expected value of utility 
(not money I ) assumption may hold. At least we do not have ai^y evidence 
to hand whl'^h shows that it doesn't. Bie iK>dem theory of utility, 
which originated with von Neusaim and Mor^nstem in the second edition 
of their famous book The !13aeory of Qaaes and Economic Behavior, Prince- 
ton: Princeton University Press (19^7), describes the conditions on 
the preference ordering such that one can work with expected utilities. 
Pbr a general survey of iK)re recent work in this and related topics, 
see Edwards, W., "OSie Theory of Decision Making," Psychol. Ball .. 51, 
1954, 380-^7 md Luce, R,D, and Raiffa, H., Games aid Daolslctis 
WUey, 1957, Oiapter 2, 

•Bie reason for all this fUss about expected utilities is largely 
math«nstical, for without this property such theories as those of 
games and statistical decisions would be vi2*tually impossible. 
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Intuitively you can easily see the power of the assumption. C&e need 
not knov the utility ftoction fop each of the infinity of gainblee 
poiBible with a finite act of alternatives, rather it is eufficient to 
know then Tar tl» fiziite set and to compute them, using expected 
utilities, for any gaaO^le. It peroite an extremely econcmical susnary 
of a person's preferences over all gaiaibles. 

So we have the foUcwing problem. Let a finite set A be given and 
let G be ttm set of all possible gaxnbles fozrod froa elements of A. 
Let Q be weakly ordered by > . To find a real-valued function u with 
domain G satisfying 

Axiom 1. (order preserving ) if a,b e G, a > b if and only if 

u(a) > u(b). 

Axiom 2. if a,b e G and a is any real number such that 0 < a < 1, then 

u(a£ab) a ctu(a) + (1 - a)u(b). 

Any flmction satisfying these conditions is known as a linear utility 
function of the weakly ordered set G. (OSie word "linear" refers, in 
this context, to the second axiom.) 

The first observation we make is that this axiomatization is not 
consistent tinless the weak ordering satisfies certain restrictive 
properties . For exan^ile, if a > b > c It Is necessary that there be 
a number a, 0 < a < 1, such that b - aoc. To show this, suppose u 
satisfies the axioms. ^Then by axiom 1, u(a) > u(b) > u(c). An 
elesentary property of numbers assures us that there exists a number 
a, 0 < a < 1, such that u(b) « cfti(a) + (l - a)u(b). .is, according 
to axiciE 2, u(b) = u(acic), so by axiom 1, b . aoc. 

This means. In effect, that pr^fterences must possess a certain 
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continuity if they are to be represented by linear utility functions . 
Zf ve think of a as a vari^e quantity, b is prefsenred to a vhen 
a » 0 and as it is inezvased until a point is inched where they are 
indifferent. After that, any increase in a (guises the ^i&ble to be 
preferred to b. Except for eert^ discrinination difficulties vhich 
people always seea to exhibit, this seeas like a plausible way for 
preferences to behave. But there asy be exceptions, as is sijggested 
by letting 

a ai five cents 

b » one cent 

c B instant death. 

tee can derive other necessary req;uirexBent6 on the weak ordering 
if the axioms are to be consistent, i.e., if a linear utility function 
is to exist. f\arthexisore, and tMs is the lisportfiuxt part of utility 
theory, von Neumann and Norgenstem took one such set of conditions — 
each of which has a certain intuitive plausibility for preferences 
and showed that whenever these are met there laust be a linear utility 
function. Ve shall not develop this theory in this section; our alas 
are Bore xnodest. 

We shall suppose that we have a case where a linear utility function 
exists and then inquire into Its uniqueness properties. First, it is 
easy to see that it is not unique, for if u satisfies the axioms and 
K is a constcuit > 0, then so does Ku. Second, s: ce there are several 
linear utility factions, we would like to know how they are related 
to one anotl^r. Our claim is this: 

tCheorea. If u and u' are twc/ linear utility fuactions, then there 
exist constants K and L, K > 0, such that 

u * Kii' L; 
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emd any such transformation, which is known as a positive linear 
transformation, of a linear utility function is also a linear utility 
function. 

Proof. lEhe second half of the assertion is easily verified and it is 
left as a problem. 

The first part is a little more subtle. Choose any a,b e G ^uch 
that a > b. Define K and L to be solutions to the following 
simultaneous algebraic equations: 

u(a) = Ku'(a) + L 
u(b) = Ku'(b) + l' 

i .e., 

K ~ u(a) - u(b) 
^ " u'(a} - u'(b} 

cmd 

. u'(a)u(b) -u(a)u'(b) 
u'Ca) - u'(b) 

Since a > b, axiom 1 implies that u(a) > u(b) and u'(a) > u'(b), 
so both constants are well defined and K > 0. 

Now, consiter the ilVinction 

u" = Ku' + L. 

tfe claim that u" = u, i.e., for every c e G, u"(c) = u(c). Since 
> is a weak ordering, exactly one of the following three cases holds 
for each c e G: 
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e > a, 
a > c > b, 
b > c. 

Each one requires rouglily the stuae treatment; we will carry out caee 
ii here, and i is assigned as a problem and iii is almost identical to 
i . In v'a ^1 , we knsfv Trm the necessary condition we derived for > 
that there exists a number a, 0 < a < 1, such that c - ac4>. Accord- 
ing to ay1.fm 1, 

u"(c) = u"(aQb) = Ku'(aab) -i- L. 

Since u' satisfies the axioms, we iise the second one and carry out 
sosae simple algebra: 

u"(c) = Ku'(aai)) + L 

= KEcai'(a) + (1 - a) u'(b)] + L 

= a[Ku'(a) + L] + (1 - Q:)[Ku'(b) + L], 

Recalling the equations which were lised to define K and L, 

u"(c) = a[Ku'(a) + L] + (1 - a)[Ku'(b) + L] 
= Qu(a) + (1 - a)u(b). 

Finally, we tise the flact that u satisfies axiom 2 to obtain 

u"(c) = Qu(a) + (1 - a)u(b) 
= u(aQb) 
=u(c). 

So we have completed the proof that u and u' must be related by a 
positive linear trans fomat ion. Thus, in any particular problem it 
is sufficient to describe one of the linear utility functions in 
detail, i.e., to give its values on the \mder lying set A, and to remark 



i. 
ii. 
iii. 
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that all others eure related to it hy meaos of a positive linear 
transfozmtion. 

Another way to say this is that linear utility functions are 
uniquely determined up to their iinit and isero, i.e., it is ccaapletely 
arbitrary which element of G ve take to have zero utility and which 
pair of eleaents we talse to he one unit apart in utility. This aieans 
that it is a loeasurement like ordinary (5klirenheit or Ctentigrade) 
temperature scales, not like length or mass where the zero is uniquely 
detenained. 

♦Prohlems 



1- Suppose u is a real -valued order preserving function with a 
quasi-ordered dcaaain. Show that the qmsi-order must, in ftict, 
he a weak order. 

2- If K > 0, show that Ku + L must he a linear utility function if 
u is. 

3- C5arry out the proof that u"(c) « u(c) for the case c >'a. 

U-From the axioms for a linear utility function, show that > 
must have the property that 

aob > a^b if and only if cr > p. 

Interpret in words what this aaans. Is it a reasonable condition? 
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CHAPOER IV 



AXICHttTiaATION OF MAITHEMATICAL SYSIEaS 

Trcm the xnathemtlcian ^ b point of vlev^ our ftsillure to emphasize 
any axlamatizations other than of functions has been^ to say the 
least, peeiiliar. He vould feel, and rightly for pure aathemtics, 
that our present topic is nsuch the laost important aspect, that our 
long chapter 3 should have heen little icyore than a footnote to this 
chapter, and, when he had ccsapleted this chapter, he vould feel we 
had done a very incGroplete Joh. Without disputing such objections 
for pure nathematics, we feel and at present this is little more 
than a conjectiure that our emphasis is reasonable for those who 
will be concerned with applications of mathematics to behaviored. 
problems. Nonetheless, because the history is short and also becaxise 
tradltiop is always an uncertain guide to the future, we would be 
unwise not to suggest the laore prevelant i;ses of the axiomatic method 
in mathematics and to indicate some of the systems which have proved 
iisportant. 

By a mathemtical system we have in mind sosaething fairly complex, 
usually with seveiul interrelated operations, which is studied as a 
whole entity. Examples are: geometry, the real or complex niamber 
system, the algebra of matrices, the theory of sets, etc. Other 
examples, derivative firam these, will appear later. In the course of 
studying such systems, studies that initially are very fumbling and 
tentative, certain concepts and operations gradually loom as more 
ijBportant than others. They seem to be more fundamental to the system 
in the sencc that they are widely used and are often crucial in the 
proofs of important theorems. Sometiii^s these are the ideas which 
have arisen early in the stucSy and which seem intuitively natural; in 
other cases they seem to be much move sophisticated concepts which have 
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required a long tine for their develonoent. Ibr example, in the 
number system the operatiouB of multiplication and addition, which 
arose very early, are still considered basic to the system and are 
the source of ideas for a great deal of modem algebra. Bat equally 
well, the idea of a topology the "near to" structure mentioned 
earlier -- appears today to be a crucial feature of the nixmber system, 
and it has led to the extremely ftrxiltful study of topological spaces 
which peznrade much of modem mathematics. 'SxIb idea was much slower 
developing, and it was really only adequately formulated within the 
last fifty years. 

As certain concepts and operations begin to stand out as cmdal 
to the system being studied, one is tempted to isolate them totally 
ftom the orlgiiial system md to stu<^ them in their ovm right, 
Bils is the central idea lying behind the ajciamtization of mathematical 
systems. Example: if we think of real numbers, they have a lot of 
properties : a notion of multiplication, of addition, of less than, 
of nearness, etc. We could single out Just one of these for isolated 
study. Ignoring its relations to the others. For instance, suppose 
we select multiplication. Bae minute we do this, we begift to realize 
that we have concepts of multiplication in other mathematical systems, 
such as matrix algebra, and so one is lead to see what conanon prop- 
erties multiplication may have in these several systems. Such a study 
finally leads to the very rich theory of groups. 



By isolating a portion of a system we mean this: One or more 
operations or concepts of a known system are selected and sciae of 
their properties, i.e., theorems in the original system, are taken 
as axioms to characterize these "undefined" operations or concepts. 
Sie choice of which properties to use is. Just as with functions, a 
ffeirly subtle business, requirtng Judgment and experience. 

C^ce an euciomatization is given, then the mathea»,ti cal problem is 
to introduce definitions -- often motivated by corresponding concepts 
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in the ortginal jnathemtical system wliich suggested the axiomatiz- 
ation — and to pi^ove tlieorems about these definitions, i.e., true 
assertions which follow ftrom the axiooffl and the rules of logical 
inference. Again, many of the central theorems, at least at the 
start, will be suggested by properties found in the original math- 
ematical system; however, as the axicsa system is intensively studied, 
there yill usually result ideas and theorems either not noticed or 
not particularly significant in the original system. 

You may ask: what is the point of all this? Our answer must be 
that such methods have, historically, enriched mathematics and science. 
For one thing, isolating a part of a complex system such as the real 
nuaibers permits us to see which classes of theorems rest upon which 
basic facts. Second, some of the systems which have been isolated 
have been found to recta* over and over in widely divergent parts of 
mathematics, and so their independent study h ft s meant that an 
elaborate set of theorems are ready for application in any context 
where operations and concepts satisfying the axioms appear. The 
abstract notion of miltiplication as formulated in group theory is 
a ease in point. Third, isolating significant subsystems of one or 
more basic mathematical systems permits us to see how they might be 
recombined in a variety of ways. Some of these new constructs have in 
the past proved extremely fi^dt^Ul in extending our understanding of 
one part or another of mathematics and in creating nev mathematics 
which, sometimes, is suited to particular applications. 2ie recent 
history of mathematics includes the intensive study of systems, the 
abstracting of portions as axiomatic systems, the application of these 
results in other parts of mathematics and the recombining of different 
subsystems to foiro new mathematical systems, the Intensive study of 
these, further abstraction, etc. Biis continual and complicated inter- 
play and re fertilization arising frcan abstracting and reeoiobining has 
proved very stimulating to mathematics. 

Although we have emphasised self stimulation in mathematics, we do not 



want to pLe^ doim tbe possibly xaore inqportant stimulation ftimished 
by tbe SKJlication of mattematics to science. It is here, priiaarily, 
that the original xoatheaaatical systems are developed and the central 
theorems, vhich often are sug^sted by ti» properties of the physical 
systems abstracted, are proved. It is anticipated that the atteznptcd 
applications of mathematics to behavioral problems vill, in the J\xture, 
prove to be the scMirce of many new and rich ideas for mathematics. 

SdDe, thou gh not all, axioaaati nations of mathematical systems aro 
a good deal like the material discussed in chapter 3 in that they 
involve fVmctions. Even so, there are two ways in ^rfiich they 
generally differ, although neither of these is strictly necessary. 
First, in very many cases there is more than one function, and the 
several factions are intertirined in sosae mnner. EKasrple. if ve 
were to abstract from the theory of sets, we would have both a ftmction 
representing union and one representing intersection and these would 
have to be interrelated in Just the way union axid intersection are in 
set theory • Second, when an axiomatization includes f\mctioris, it is 
usual for the range and the domain of the function to be extremely 
closely related. Example: suppose multiplication of numbers is to 
be abstracted. In that case one assigns to every pair of xnsnOt^rs, a 
and b, a third number ab cal led the product of a and b. This suggests 
that in the abstract formulation there naist be a function with some eet 
R as its ran^ and R X R as its domain. Or, if we try to abstract set 
theory, one operation which must be taken into account is complementa- 
tion, ^Aich assigns to every subset of U another subset of U, namely, 
its complement. Bius, in the abstraction we would have a function with 
both domain and range Bcase set A, where A plays the role of 2^. In the 
usual terminology, many of the operations which concern us are "closed." 
We take one or more elements frcmi a given set and the operation leads 
us to another element in the sas» set. dis sort of closure is re- 
flected by having the domnln of the function which represents the 
operation closely related to its range. 
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ait one should not get the idea that all of the systems studied 
asdlonatically are based on ftinctlons. Actually^ we have ali^ady 
seen several ^ses which were not, althoiiigh at the tiioB ve did not 
jaention that we were using the aadooatic nKthod. Our definitions of 
different classes of relations — reflexive, syanietric, etc. w«re 
really simple axian systems. Similarly, our definition of an alxrebm 
of sets could be treated as an axiom system. 



h.2 SOMB OSRICINOLOGY 

As in the asdonatization of fVxnctions, one has problems of 
existence, uniqueness, etc. Actually, slightly different questions 
nwst be phrased and some of the emphasis is, for good reason, different. 

Oonsistency . The first question here, as with functions, is whether 
the axioms as a group are consistent, i.e., whether sojaething exists 
which satisfies them. It is usual to call any mathematical structure 
which satisfies all the axioms of a given system an interpretation of 
the system. For the most part, this problem is either extremely simple 
or extremely difficult, depending upon how you look at it. Since the 
axioms in general arise from some special nathenatical structure, such 
as the real numbers or set theory, which has already been investigated 
and is ^neially accepted to exist, they are trivially consistent. This 
is the simple way of looking at it. But one can question how we really 
know that the number system exists. Are we not living in a fool's 
paradise by supposing that we cannot prove contradictory results within 
that system? While this is a fruitfld skepticism fxcsa. a pure isath- 
ematics point of view, in applied work one usually takes a far more 
pragmatic approach and assumes that the well known systems do in f^ct 
exist and that they will serve as demonstrations of the consistency of 
an axiom system. 



Cacrpleteness . The direct analogy of uniqueness for axiom systeias 
is completeness, aeaning, roxighly, that there is at xnost one possible 
interpretation of the system. By and lar^, this concept is not of 
the sax&e practical iarportance for systems as it was for functions, 
because siost of the axiomatizations are not conplete. Indeed, much 
fimdamental research on the completeness of systems^ stensoing in 
large part from work of Godel, has shown that it is very rare to find 
a set of axioms vhich are both consistent and complete* Such vork 
has been extresiely important in understanding the fouriHations of 
mathemtics and in soiae respects it has been profoundly disturbing, 
but fbr applications it need Tx)ther xis but little. Of much greater 
relevance to us is the next notion, 

CSategoricalness > Au axioms system vill be called categorical if, 
roiighly, any tvo interpretations of the system, while not identical, 
are formally the same in the sense that one can be "superixnposed" on 
the other in such a way that they look alike. QSiat is to say, 
elements of one can be identified with eleiKnts of the other and 
operations in one with operations in the other, so that corresponding 
operations take corresponding elements into corresponding elements. 
We will go into what we mean by this much more fully in the next 
section, for it is an important notion. 

In practice, this ajMunts to having uniqueness, for it TT W^n nfi that 
if we have investigated one interpretation of the system fully, then 
we know how all others must look, for we c»n set up an identification 
of elements and operations so that they are formally the same. 

When an axiom system is not categorical, then problems arise which 
are similar to non-unique axiomatizations of ftinctions • Can we 
establish how one interpretation maps into another? If not, can we 
classify the several interpretations into some reasonable taxonomy? 

Independence . One axiom of a system is said to be independent of 




the others in the systea if it is not a logical consequezxce of thea. 
Ooe fihovs this is so by finding an interpretation ^^ch meets all the 
remaining axLoiBs hut i^ch l^ils to meet the one under consideration. 
It is clear that if such em interi^retatlon can e3d.st^ then it is 
impossible to derive the one axiom txaa the oilers. If this can be 
done for each of the aidLoms in a system, then the system is said to be 
independent. 

Qiis notion is not really terribly iiaportant for most purposes. Tb 
be sure, it is nice to get rid of obvious redundancies in an axiom 
system, but often the less obvious ones are leli in fbr either 
psychological or pedagogical reasons . A redundant axicm system is 
often much more intuitive and easier to recall than one that is 
independent. Of coux^e, it can be an intriguing mathematical gyuy* 
to be certain that a particular set of axioms is independent and, 
if not, to devise one thati is, but only rarely does this result in 
a valuable contribution to the understanding of the system. Some 
Jitdgment is generally necessary. 

Weakness and Strength . Allied to the concept of independence is 
the scientifically more important question of which of two axiom 
systems for the same concepts ie the weaker. Such problems arise from 
the feet that there is never a unique way to sxiomatize any concept. 
If we are abstracting ftrom a given mathematical system, we choose 
certain properties of the original system as fl-x1nme and tram these 
derive other properties as theorems. It is quite arbitrary which of 
the iroperties we choose to take as axioms and which we try to derive, 
thou^ in general there is not really ccsnplete freedom in this choice. 
Bie axioms should be, in some sense, simple, inanediate of comprehension, 
ai^ appealing to the intuition. But even within these vague criteria, 
there is a good deal of free " m in their choice . 

Now suppose A and B are two axiom systems for the same undefined 
concepts . We say that A is stronger than B (equally, B is weaker than 
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a) if it is poflBil^le to derive all of the asdotns of B frcm those of A, 
but the converse is not possible . If we can derive all ve want or need 
from a veaKer axiom f^ystoia we shall always prefer it to the stronger 
one. Bie reason for this is clear: we invariably want to asstmie as 
little as possible to get the results we need, and so of two axiom 
systeBis which give us these n suits we prefer the weaker one. HiiQ 
does not den^ that .rem the stronger system we can derive "Uneoresis 
which we cannot prove for the weaker one, but rather that, for what- 
ever reason, we are not interested in these extra resiU.ts. 

It should be mentioned that it is not fidwaye easy to apply the 
above principles. A particular theorem which we need say appear to 
require all the axioms of a particular systan and, therefore, 
appear not to be provable wittiin a weaker axicOT system B; yet it is 
well known that appearances can be deceiving* An ingenious sathexaa- 
tlcian may be able to derive the theorem f^^mi B, even thou^ the 
original proof seemed to rest on everything assumed in A. Often this 
can be a very valmble contribution as, for exsmple, when the axioms 
of A seem too strong to be tenable in scsae empirical context, but 
those of B are acceptable. 

U,3 CAIEGORICAIJaESS AND ISOMORPHISM 

As we pointed out above, it is fairly rare for an axiom system to 
be complete, i.e., to have a unique interpretation, but it is much 
Biore coamon for one to be categorical, i.e., ^r the interj^tations 
to be formally the same. In this section we wish to make clear, 
without being completely precise abo\rt it, what we xoean by two systems 
being "formlly the same/' 15ie word which is used for this notion is 
iscBDorphism . What we will do is define iscanorphism of two vejry simple 
classes of systems and then suggest how it must be defined more 
generally. 

The simplest c e is simply that of sets having no structure of any 




sort upon them. la that case a special word instead of isQsaop|diisui 
is used. !IVo sets A amd B are said to be in one -to- on e correspondence 
(usiiaily written 1:1 correspondence) if there exists a function f firoa 
A onto B which has an inverse. Let us see what this saeans. First, 
since "ftinction" sieans "single -vulued function" there is Just one 
element of B associated to any one eleiaent of A, and, since the 
function is onto and has an inverse, there is associated to each 
eleinent of B just one of A. In oliier words, there is a one-to-one 
pairing of the elements of A and B. 

It is easy to see that if A and B are finite sets, then they can 
be placed in 1:1 correspondence if ^nri only if they have the saiDe 
nuiaber of elements . But be carefUl about carrying over notions of the 
meaning of 1:1 correspondence from finite sets to infinite sets. If 
A is finite, there clearly cannot be a proper subset B which is in 1:1 
correspondence with A. But if A is infinite, this is possible (indeed, 
it is one way to define what we mean by infinite). (S>nsider, for 
example, A = set of integers and B « set of even integers • CCLearly, B 
is a proper aiabset of A since all the odd integers are not included in 
B. But we claim that there is a 1:1 correspondence between A and B, 
namely f: A -^B, where 

if a € A, f(a) = 2a. 

Since a is an integer, 2a is an even integer. Hie mapping is onto 
since if aa is an even integer, a is an integer. And f has an inverse, 
namely, f"^(b) =^ b/2, b e B. 

Any infinite set which can be pit into 1:1 correspondence with the 
integers is said to be a countable (or denumerable) set; otherwise it 
is said to be non-countable . By what we have just seen^ the even 
integers are count^le« Equally well, so are the odd ones. Less 
obvious is the l^t that the set of all fractions (numbers of the form 
a/b, where a and b are integers) is also countable. If that is so, one 



might be tempted to suppose that all infinite sets are countable, but 

ve can shov that this is not the case. Consider the set of all real 

numbers lying between 0 and 1. We shov that this set is not countable 

To do this, ve suppose that it is in ffe^ct coimtable, i.e., there is a 

first (the one mapped into the integer l) vhich ve denote by a^, a 

second (the one mapped into the integer 2) vhich ve denote by a^, etc. 

It is, of course, veil Icnovn that any real number can be expressed as 

an infinite decimile expansion of integers trcm 0 through 9. Let txs 
th 

denote the i Integer in the expansion of a^ by a^, i.e., ve have 
the ^ray 



^2 " ^-^21 ^22 ^23' 
^3 " °'^31 ^32 *33' 



Q nl n2 n3 nn 



How, let VLB conBider the real nuxi^r 

b = 0 .b^bgb^ . . . • , 

vbcre 

= \i * 1. If ^li ^ 9 

0 , if a^^ = 9 

Ve clalgt that our cotmting has Ignored tliis nujaber. If not, then 
it Is soeie maaber in onr list, say the n^. Nov consider the decimile 
expansions of a^ and b . By choice the integer in the fonaer is 
a and in the latter b_ ^ a . Thus, they are not the saxoe mcsber. 
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so b vas GBitted fttn tbe counting. But tiiis is contrary to choice, 
so such a counting cannot be possible. 



So, for sets without any asmnaed. structure, 1:1 correspondence is 
vhat ve aean bjr isoBonthisa. Whenever there is sone structure under 
consideration, the idea becooes a little zasre complex. BDssibl^ the 
sljj^plest case is sets having a single relation defined on them. 

Suppose A and B are sets with relations R and S, respective}^. 

We say the system (A,R) is isooorphic to the system (B,S) provided 

ve can find a 1:1 correspondence f between A and B such tl^t both f 
-1 

and f are order preserving, i.e.. 



Oraphically, this is particularly easy to see. Consider the two 
relations 



if a,b € A, then aSb impUes f(a)Sf (b). 



and 



if x,y e B, then xSy implies f""^(x)Rf''^(y). 



1 



2 



a 



b 





d 



c 



We claixi that these are iaaaaorghlc . Ilils is eauily checked once you 
m a ke the 1:1 corresijondence of the points: 



1-b 



2-d 



3-c 
U-a 
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Another case where isoirarphism is siinple to define is aiaong sets 
having a multiplication structure. As ve pointed out before multi- 
plication in a set A aiwnxnts to a function from A X A into A. It is 
usual, hovevier, not to use functional notation, but rather soiae uymbol 
such as aob or a*b to stand for the elen^nt which is the '*inroduct of 
a and b." Suppose (A,o) and (B,*) are two multiplicative systems. 
We say that they are isomorphic provided that we can find a 1:1 
corTv^spondence f between A and B such that f and f both preserve 
the multiplication, i.e., 

if a,b € A, f(aob) = f(a)*f(b), 

i\nd 

if x,y € B, f"^(x*y) = f ■^(x)of^-^(y) . 

The generalization to more complicated mthematical structxires is 
probably clear. We begin with two sets, each having a series of 
operations, functions, relations, and the like. A 1:1 correspondence 
is established between the operations, etc., and another between the 
elements of A and B. If the element -wise correspondence has the 
property that both it and its inverse preserve the effects of corres- 
ponding operations, then we say it is an isomorphic napping of the one 
system onto the other- If such a mapping exists, then the two systems 
are said to be isoiiK>rphic • We will not try to make isomorphic any 
more precise than that. 

As we said earlier, most axiom systems are not complete, but 
many are categorical in the sense that any two interpretations are 
isomorpbic . 

Problems 

1 -Establish whether or aot the following pairs of relations are 
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isaBaorpi:d.c . 





a 



\ Y 



li. 





^ »c 



2- Let M deoote a class of sets, each set having a relation defined 
over it. Consider iaoEoorphiaia of pairs of sets and tJieir relations 
as a relation over M. Siov that it is an equivalence relation. 

3- Show that the positive real nusibers under multiplication are 
isoDozTbic to the set of all real numbers under addition. 



k,k BOQI£AN AIIIEBRAS 

(Xir first, and primary, example of an axioanatic system arises f^rcm 
set thecny. The interpretations of the system that we shall present 
are kaomi as Boolean al^hras, tte name honoring George Boole who 
laid "tbe foundations of set theory. In one way it is a poor example 
of art o a at iaation, for it is somewhat unrepresentative . Rather than 
select scxae portion of set theory to serve as a guide for the axiom 
syst^, we shall tisc the entire structure: axians wlH be given for 
"undefined" operations asnlogous to all of those of set theory --to 
union, intersection, coi^LLeBientation, and inclusion. It is much 
Bore usual to attempt to abstract scrae limited, but crucial, portion 
of the original system; we shall see two examples of this using the 
real nuaber system as the source of ideas. Actually, there are such 
al)stractions tram set tlMsory. for exasiple, if one abstracts the 
inclusion relation and the fhct that the union of A and B is the 
smallest set which includes both A and B and the intersection of A 
ax^ B is the largest set included both in A and B, then one has the 




axioms for vhat are known as lattices. But because Boolean algebras 
are quite important and we already have seme background in set theory, 
we shall use them -- even though they are not fully representative -- 
as our examjile of bxx axionatization. 

Let us suppose that we impose on a set B four undefined operations 
which correspond to the four mjor operations in set theory, and we 
specify that they must satisiy properties which correspond to some of 
the theorems which can be derived in set theory. But there are an 
infinity of true theorems in set theory, so which shall we select? 
ThlB problem always confronts one in an axiCBnatization, and a wise 
choice among these possible axioms is always a mjor intellectuELl 
feat. Often when an abstraction is first being formulated and 
investigated, several different axiconatlzations will be put forward. 
Sometimes they all persist in the literature, but more often experi- 
ence with the several formulations leads to a decision as to which is 
preferable. In the present context, we don't really have to enter into 
the pros and cons of different axioms, for tliere is widespread indeed, 
total — agreeuKnt. Eiis isn't to say that there are not a nuaibcr of 
different systems for Boolean algebras available and used, but only that 
they are all equivalent to each other. !Ihe set of theorems irfiich we 
shall use as axioms are those listed in section 1.6. It is reccaaaended 
that you reread that section now. 

So, to be more precise, we assun» as given: a set B which has at 
least two elements ^ and u -- these will play special roles correspond- 
ing to the null and universal sets — , a relation R on B, and three 
functions 

: B X B -* B 
•* B X B -» B 
F^: B -*B 

liDtatloDal convention ; Since the relation and the three functions arc 
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to play poles paralleUng the lisual set operations, it is convenient 
to use a pamTlH notation. In actual joractice, exactly the same 
synflxjls are eaiplpyed; however, beSre we aHan add a star tP each of 
the usual syabols in order to emphasize the distinction betran these 
operations vhich are to he asdooatized and the fhmiliar set theoretical 
operations . aSjos, if a,b e B, ve write 

a C *^ for aHb, 
a U *b for Fj^(a,h), 
a n *b for P^(a,b), 
a* for F^(a) 

It is extroaely important to tinderstand that these starred 
operations have nothing to do with inclusion, union, intersection, 
and conplementation among the subsets of B. They stand tor relatione 
and functions defined in terms of the elements of B, not in terms of 
its subsets . In tbm aadooatization, the elements of B will play the 
role of siibsets in s^t theory. In other words, if U is a universal 
set, B corrospotids to 2^, not to U- 

A system ( ^ U *, n *, C *, where the ranges and draaains of 

the operations are those given above, is called a Boolean algebra 
pETOvided that the following axioans are satisfied for every a,b,c e B: 

Axiom 1. a C *s- 

Axiop 2. if a C ♦b and b C *c, then a C *c. 

3« 4C*a- Axica 3' . a C ♦u. 

Axlcn if. a u «a = a. Axiom h\, a n «a = a. 

AacLoia 5. a U «b = b U «a. Axiom 3' . a n *b = b n 

Axiom 6. a U ♦(b U ♦c) = Axlosa 6'. a n ♦(b fl *c) = 

(a U *b) U ^c. (a n *b) n *c. 

^om 7. a U *(b n *c) = Axions 7 ' . a n *(b j *c) = 

(a U *b) n *(a u *c). (a fi *b) j ♦(a n *c) 

Axiom 6. n *a = 4. Axioms*, u U *a = u. 
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Axiom 10. a U *n = u- 



Aadom 10^. a n ^ « 4- 



Aadoo U'. a n = a"*" U ♦ b 



Axiom 12. 



a » a* 

l^ch of the fbUoving implies 



Axiom 13, 



the other two: 
aC*b^ an*h=a, au*b=b. 



The first problem ve snist consider is whether this axiom system is 

consistent. It certainly is for some sets for all \m need do is 

U 

choose a set U asd let B ^ 2 and tlu resulting algebra of subsets is 
certainly an interpretation of the system. A theorem which we shall 
state below shovs that the axiom syst^ is only consistent for certain 
sets B. 

Second^ why did we choose this particular set of theorems of set 
theory to use as axioms? !Ihe answer is reasonably clear if you recall 
the statement we made yben discussing the corresponding theorems in 
set theory to the effect that it is possible ftcm ti^se theorems alone 
to prove any other theorem which can be phrased in set -Uieory concepts . 
Jt is never necessaiy to resort to arguments involving elements of 
subsets. Bbus, in any Boolean algebra it is always possible to derive 
from the axioms any theorem whose corresponding statement is true for 
sets. Bat if that is so^ it must mean that fiusy inteirpretation of a 
Boolean algebra cannot really be very different from the algebra 
generated by the subsets of a given set. Among other things^ we 
might conjecture that all interpretations in which the tmderlying 
sets B are in 1:1 correspondence are isomorphic, liiis, and a bit more^ 
is true, but our way of arriving at it has hardly been honest. It has 
been built upon our statement in C3iapter 1 that any other true theorem 
for sets could be derived directly from those which we listed, but we 
did not prove this statement. 

It actually follows from the central representation theorem for 
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Boolean algebras to which we have been leading i^. Tbe theorem is 
this: Any interpretation of a Boolean algebra is isomorjiiic to an 
algebra of sets (see section 1.8), which is, of course, also an 
interpretation. This says not only that any two interpretations which 
are in 1:1 correspondence are isomDrphic, but also that there are no 
interpretations which are not isoanorphic to an algebra of sets. Thus, 
whenever we have to think about a Boolean algebra, we will not be 
misled by thinking of an algebra of siibsets of a given set with the 
operations of union, intersection, inclusion, and coBrpleaentation . 

But if this is so, has there really been any point to the 
axioo>ati2»tion? Won't all interpretations be so imaediately parallel 
to set theory itself that the axionatization is strperfluous ? ^I^ro 
rather distinct exaaxples suggest that this is not so. The first we 
shall sketch briefly now, and you will study it and related topics 
much aiope fully later; the second will be presented in the next 
section . 

Consider elementary logic. It begins with a set of propositions, 
i.e., statements which can be either true or Raise. Examples: "a red 
automobile must be a fire engine," "Mt. Everest exceeds 10,000 feet in 
height, " "a tree is a tree or a house, " etc . Of these, the first is 
empirically false, the second enrpirically true, and the third 
tautologlcally true. R>ur basic logical connectives can be identified 
trtiich allow us to form new propositions tram old: If p and q denote 
propositions, then we can form the poi^Dpositions 

p or q, p and q, not p, and p implies q. 

It is generally aseimied that these connectives satisfy certain 
properties. Biese lie so deep in our early training, and are so 
closely integrated with experience, that we sometimes forget that 
they are unproved asstagptions — or Avirma of the calculus of 
propositions. 5br example: not (not p) = p, p or q q or p, etc. 
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It turns out that if ve mske the follovlsg identifications 

"or" for U* 

"and" for rr» 

"not" fbr -» 

"implicB" for C*, 

then each of the axicos for a Boolean algebra becosoes one of the 
usxial assuBsptions of logic. In other vords, the nathenatical 
structure lying behind our ordinary prepositional logic is the same 
as that for sets; it ia a Boolean algebra. ISais is not unreasonable 
when you remember that A U B is the set of elements either in A or 
in A n B the set of elements in A and in etc . 

Oae final point should be made . Hie axlcxm ve have presented are 
fax from being independent; this is suggested by axiom I3 which says 
that %re ccnild have defined some of the operations in terms of others. 
In the literature one can find a number of different independent sets 
of axicns for Boolean algebra, and there is one which Is based tqpon a 
single undefined operation (imovn as -Uie Sheffer stroke). Ve have 
chosen a non-independent set for our discussion because in this form 
they are pa:rticularly simple and intuitive; the axicans of the 
independent sets tend to be somewhat more obscure, fbr a much more 
detailed discussion of these points see Birkhoff 's lattice Bieory and 
for a less conprehenslTe, but sixopler, discussion see Birkhoff and 
IbcLaoe's A Survey of Modem Algebra . 

Probleos 

1- Shov that every Boolean al^bra has a Boolean subalgebra of 
j\]st two elements. 

2- Ceflne A>mlly what it aeans fbr two interpretations of a 
Bool^n algebz« to be isonorphic. 

♦3-Let U be a set. Ibra the n by n matrices having as entries, 



not nusbers as in ordinary matrix theory, but siibsets of U. 
Qms if demtes the entry in the ith rov and Jth column 

of the Batriz A, A^^ C Oaa you see plausible ways to 

define the Boolean operations A u *B, A n *B, A C *B, and 
-* 

A f ylbexe A aM B ax« such matrices, so that the set of all 
such n by n Bool^m matrices Ibn a Boolean algebra? ^y 
analogy to ordinary matrix multiplication, we can define 
Boolean matrix multiplication as follovs: ^Qie ij entry of 
the product of A and B, written AB, Is the subset 

(A^ n B^) U {A^2 n Bgj) U....U (A^^ n B^) 

Suppose ve thizik of the rows and coXuxons of the matrix as 
repK8entiDg people and of U as a set of inforzsation. What 
is the analogue to the ecsmnunication iuterim^tation of ordinary 
satrlz sniltipli cation given in secrbion 2.3. 

k.^ SOTCHiNs cmcuns 



A svltch^ as ve shall use the terxQ^ is any device vhieh is alvayB 
ia one of two possible states, vhieh can be called "on" and "off." An 
electric knife svitch of the type shovn 
in Fig* 21 is a good exaiople. Such 

inp^t 

switches are 'Vired" into circuits to > 

fom iDore complicated switches of the 
same ^neral sort, i.e., under sosae Fig. 21 

conditions they are on, xinder the reaaining they are off. If a 
svitch is in the "on" position, cui-rent from the input viH flov 
throtjgh a vire attached to the "on" tenninal, but not through a wire 
attached to the "off" teminal. Each distinct svitch in a circuit 
will be given a name such as p or q. In scMe circuits there will be 
tvc physically distinct switches which are "ganged" together so that 
they are on together and off together* In such cases, the sazoe symbol 
win be used for these switches, for they are functionally the same. 



tfe propose to shoy^ that the algebra of such circuits is a very 




on 
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silsple Bcx>lean algebra axui that this ie useAil to know. Suppose it 
is a Boolean algebra, then since a switch has only tvo states it is 
presuaable the two el eaent algebra u} iriiich is relevant. Let lis 
identify the eleaaent 4 with the "ojPf " teradnal of a switch and u with 
the "on" tenainal. Now if p is a switch, we say that p = 4 if the 
knife is in the "off" position and p = u if the knife is in the "on" 
position. Now, consider the switch p: 

if p = 4 r tlten p = ^ = u 
if p = u , then p = u = 4 . 



So p is the switch which is on when p is off and off when p is on. 
Rjysically, p can be obtained from the switch p simply by interchanging 
the connections to the output tejminals, , ^ 



as in Fig. 22. 

Now, if p and q are two switches, 
then p U q is a switch with the following 
proijerties : 



pUq = 4i^'P = 4 and q = 4^ 
= u otherwise. 

Oiis amounts to wiring p and q in 
parallel, as shown in Fig. 23. 



Similarly, p n q is a switch with 
the laroperties 




u 



A 

B 




Hg. 23 



r 



"t — ^ 

1 


. - 


u q 






pnq=uifp=uandq = u P^^^' ^ 

= 4 otherwise- 

Fig. 2k 

'BxlB corresponds to switches wired in series, as in Pig. 2h. Note 
the strong duality between these two drawings . 



T u 
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Observe, both f^rom the algebra and the drawings, that p J q and 
p n q are a^in switches of the sanse basic type: they have one 
injwt and two output terminals and they are in one of two possible 
states. Either current will pass out of the off teitninal or out of 
the on terminal. repeated application of these two constructions 
plus negation, any exjaression which C€tn be fonKd in the two element 
Boolean algebra can be reproduced as a switching circuit. Thus, for 
example, statesients in elementary logic can be reduced to switching 
circuits . 

Exacrple: Design a circuit so that a light can be turned on by 
a switch at any one of three doors . Let the switches be denoted by 
p, qj and r. Bie overall circiiit is to be "on" whenever either of 
p or q or r is "on, " i.e., it has the formula p U q U r. By one of 
the axioms of a Boolean algebra, this can be written (p U q) J r. 
Olhe circuit for p U q is given in Fig. 23, so (p U q) U r mast be 
the one shown in Pig. 25. 
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Exaisple: A light is to indicate when two switches p and q are 
both in the same position, i.e., the light is to be on if and only 
if both p and q are on or both are off. Thus, the forxnula for the 
circuit is (p 0 q) U (p n q). The construction for this circuit 
is shown step by step in Pig. 26. In actual construction, the jairs 
of switches with the same labels would be ganged switches operating 
together. 
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Tbe aerit of laaMng the identification between svitching circiiits 
and the two eleaent Boolean aXgebra is that it l6 ccxoparatively easy 
to traaslate a cooplicated verhal stateiaent of the conditions to be 
met into an algebraic fonmla, then to use the axioms to reduce this 
expression as ouch as possible, and then systemtically to realize 
the siaqplifled expression as a circuit. 

Exaaple: Oppose that a circtiit raist be designed to lock the ^te 
of a plant. It is stipulated that the gate shall ^ open only "vhen 
one of the folloving ccmditions is xaet: 

i. a switch p in the president's office and another, (i, at the 
guard*! station are both on; 
ii. vi^ p is off, the gate is open if both the guard's svitch 
and one, r, controlled by the security officer are on; 
iii. to insure extra protection at night tl»re is a tijae clock 
nriteh which, when off, keeps the gate locked unless a1 i 
three switches — the president's, the guard's, and tiv 
seeuri-^ offLeer's — are on. 
Desi^ this circuit. 
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Bic circuit aust be in one state — on op off, it doesn't really 
mtter — if and only if one of the fOllcwing cojMUtions are net: 
either 

i. p n q, or ii. p n <i n r, or iii. 8 n p n q n r. 
ISnis, the overall circuit ie 

(p n q) u (p n q n r) u (b n p n q n r) . 

A few iaani|Mlations of the axioms ahovs that this Is equivalent to 
the circuit q n (p U r). Interpreted ver^ially, the gate is open if 
and ozily if the guard's svitch is on and either the lo^sident's or the 
security officer's is also on. In other words, the time clock plays 
no role and the president and security officer have the sazae degree 
of control. Bxe realization of the circuit is shown in Fig. 2?. 




Fig. 2T 



It should be added that there are a variety of ways of drawing 
the schemtiCB of such circuits. Biis style was chosen because it 
ehavs very clearly the dual roles of union and intersection (see 
Figs. 23 and 2^*). 

Rroblems 

1-Qraw the circuits for p U p and p n p in terms of the single 
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(gaoged) iviteh p. Qjr diwiog the tvo different positions for 
knifiB in p/ abov that the former emoantB to a vlre and the latter 
to an open circuit. 

2- ProTC Cp n q) u (p n 4 n r) u (s n p n q n r) - q n (p u r) 

nains the axlcu of a Boolean aXgebra. 

3- &W«« A door is locked if p is off, or q is on, or if p is on 
and q Is off. Sspress this circuit algehraically, slapUfy, and 
drair thA resulting circuit in tezas of the tvo svltches p axid q. 

*k,6 EXXSSSCB OF LZHBAB tmLXTT FQSCTK^ 

Judging our e^piiaais on the axiooatization of functions, it Is 
rMsonable to conclude that aost of the successful aadLcnatizations 
related to heharioral pcrobleass have assuaed that torn, Eomsver, some 
iaportant ones exist which are axioaatisations of systems, not functions. 
Qoe of the simplest to describe, and one for which soaie background vas 
established in section 3.11, Is the axiosiitization of a relation over 
a set of gEusbles such that a linear utility function exists . You vill 
recall that vben ve first encountered thXa probl^ ve presented some 
of the background and then inquired into the uniqueness of such 
ftinctions vhen they do exist. Of cou»e, it is of even sk>x« Interest 
to know vhen they exist, for if ve kno« vhst conditions che prefex^nce 
relation nost aeet then ve may have sooe idea vbether it is suitable 
to use l ine a r utility functions to represent preferences. 

As background for this discussion. It vould be vise to reread 
section 3*11' There ve began vith a finite set A of alternatives 
and froa this generated the set G of all gables based upon A. Qoe 
vay to look at G is as the set of all probability distributions over 
the eleaients of A. Another vay Is to think of G as eomposed of all 
elcnents of A and all elenents of the fona act), i^re a,b c G at\a a 
is a real nuniber, 0 < a < 1. Such an elencnt is Interproted &b the 
guffibl e In vhlch the outccsae ia a (posnibly another gsai^le) If an 
event having probaibllity a of occurrlag actually occtirs and b If the 
event t&ila to occur. 
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eleoents of G are all possible outcoaaes vMch B»y arise from 
the basic outcooes A in a situation where there is risk — where 
chance events play a role in deciding emctl^ i^t outccsne will result . 
It is asBimed that any given person will have psreferenees not only 
among the alternatives in A but also among all the gaiables in G. Let 
us denote this preference relation by >, vhere a > b neans that he 
prefers gamble a to gaaible b or he is indifferent between th^. 

For the reasons cited in 3-11, it is of interest to know when a 
real -valued function u with doBiain G exists having the two properties: 

1- (order preserving) a > b if and only if u (a) > u(b), 

and 

2- (Unearity) u(aQl)) = cai(a) + (l - a)u(b). 

Such a lUnction, when it exists, is known as a linear utility function 
(for the preference relation > on g), and we established that, while 
not uniqiffi, it is determined up to a positive lij^ar transformation. 

Uhe problem now is to establish coE^tions on > such that a 
linear utility function exists. It will be recalled that, to prove 
the uniqueness result, we found it necessfu^ to derive in section 3. 11 
a property which > woiad have to be met if a linear utility function 
exists. It was: if a > b > c, then there exists a probability a 
such ti»t aac - b. It seesm plai;sible that there are other ja^perties 
which we might establish in much the same way. Some of these might 
be independent of thi* ones jireviously derived; others might 
logical consequences, Rirthermore, it is platisible though not 
certain — that if we derive enough of them we will finally be able 
to show that whenever these are met, then a lin^Lr utility function 
has to exist. Such a set of properties > constitutes the axicaiBtlza- 

mm 

tion for which we are looking. As in i such aadcosatizatlons, there 
is no unique set of axicms which will yield the result we want. 
Various, apparently quite different, sets will do equally well in the 
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sensf^ tiiat they are all logically e<iuivaleat to each other and ftrca 
any of them existence of a linear utility function can be establi^aed. 
The choice aaong them is jnxrely peycholc^cal. Qae wantB axioms 
vhich are fhirly siisple to xmderstand and which have a certain 
plaiisiMlity. Ve want thea to be in a fozn that a person vill 
agree (before he Imovs the theorea) that prefterences do (or should) 
satisfy these conditions. Fbr^ by agreeing to them, then he h fiw 
implicitly agreed that preferences can (or should) be represented 
by a l i n ea r numerical utility faction « nMs is socaething ve cannot 
expect him to agree to directly, and the vhole point of the axiomtisa- 
tion is to transfoxm the problem to a different level where he is more 
certain how preferences do (or should) behave* 

Let ua present such a set of seven suitable axicms, 

Axicd 1. > is a weak ordering of G. 

As we pointed out earlier^ this axioss mist be satisfied by any 
preference relation ^rfiicb is to be Blmply described niiii»rically. 
Intuitively, there seem to be two major donbts aboiit it. First, it 
implies that strict preferences are transitive: if a is preferred 
to b and b to c, then a is preferred to c. It seems that we all 
feel that preferences should like this, but it is not difficult 
to devise sets of alternatives which lead people into intransitive 
traps. Second, it supposes that indifference is also transitive, and 
that seems qiiestionable . For pxaaple, in seasoning food most of us 
would agree that we are indifferent between a given amount of pepper 
and that plus one grain more. But if indifference were transitive, 
we would have to conclude that we are indifferent between any two 
oaoants of pepper, which is silly. IVo alternatives seem possible; 
either ve can attenpt to change the model quite seriously, for instance 
by introducing ptrobabilities of preferences, or we say that a 
weak order is an ans^adnation to reality — an approxLuation which 
is sometimes pretty good. 
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Axlcm 2. a > b > c iaplies there exists an a, 0 > or > 1, soch 
tbat aoc _ 

IbiB cotidition was derived In section 3.11, and ve discnxssed its 
■Nwlne there. It aoounts to saying that there is a continuity of 
preferences. Again, it is doutotlVil that it is ever strictly true 
tor preferences, but it seems like a plausible approxisation to 
reality. 

AxiQBB 3. Let a be any number such that 0 < a < 1, then a > b if 
and only if aoc > boc for any c € G. 

Assuadng a linear utility function exists, this property of > 
is proved in such the sazae vay as the preceding property. It has 
a very reasonable meaning: if you jarefer a to b and then foim the 
two gambles aoc and boc (note -Uiat the same probability and the same 
alternative c enters into each gasible), then your preference for a 
controls your preference between the ^usibles. 

Axiom k. aoa ^ a. 

Arjom 3. acb « b(l - a)a. 

Axiom 6. alb . a. 

f These three are extremely sinrple to prove. For example, to 

ehov axioia k, 

u(aaa) = Qu(a) + (l - a)u(a) = u(a), 

by linearity of u. But since u is order preserviug, this implies that 
aoB ^ a* Hiese are eqixally easy to interpret. Jiist think of what aoa 
iDeans and you see that a person would hare to consider it inference- 
wise indifferent to a. Bie other two are equally plausible. 

AxiOBi 7, If a and 3 are not both 0, then 
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aoCbpc) m (a ^ ^ ° _ op b)(a + p - ap)c. 

This 10 azTlved at as jToOlavs: 

u[aflt(l>pc)] « Cto(a) + (l - a)u(T30c) 

« Qa(a) + (1 - ce)^tt(b) + (1 - a)(l - 3)u(«) 

- ^« ^ P - ^n^^/r^ u(a) + (1 - ^«-^_^Xb)3 

+ (l - a - 3 + o^Mc) 
= (a + p - Q^Ma ^ ^ ° ^ ^ b] + [1 -(a + p - a^)}u(c) 

Pasaibly the eaalest i#ay to criticise this axicxa is first to 
consider a special case of It in conjunction with nv^tmf k, naiaely: 

(adb)^b « aoP). 

The assiDsption then is that the two stage gaable on the left, vhieh 
involves only two ultlamte alternatives, is held indifferent to the 
one stage gaable on the ri^t. First, we observe that the two basic 
alternatives have the saae prol^bility of occturrlsji; in both eases. 
Bius, rationally, it certainly is a reasonable assunqjtion, bitt it 
does Iflrply that the person does not receive any pleastire from the 
gai^ling itself. OHLy the final chances over the alternatives count. 
Bsssibly, it is reasonable for certain important applications, sucn as 
business ones. !Zbere, one would hope, only the risks involved should 
be considered, not whether they are divided into one or two stages. 

Sven if you feeX, as we do, that aost people's preferences do not 
satisfy these azicBS, you can still feel that under some conditions it 
would be desirable for a decision oaker to satisfy ti^. If so, ti»n 
you are saying that idt^Oly his preferences should be represented by a 
linear utility fttnction, for it can be shown (we will not do so here. 
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but Me problem 3) tbat aay prefeiwnce relation > on a set G of 
gambles vbich satisfleB these seven aadoas can be represented by a 
linear utill'fy ftmction. 9iis ftaous tbeorea ims first proved by 
von Senaaum and Morgenstem in the second edition of Bie B>eory of 
Games and Eetaaoadc Bsbavior . 

As ve said, a nuaiber of other equivalent axLass systos can be 
found in the literature. Sie only aerit that radJy can be elaiaed 
for one over another is that the aziOBs of one seem more intuitively 
reasonable. Ttnare are massrons counter intuitive esousples available 
where one or annther axiom appeare to be untoyikble. 

Oae of the aain uses of this theory is to Justify intitjdueing 
nuaerical payoffs into the tl^ozy of games. In section 2.6 ve 
described vhat is m^uit by the rules of the game . Among other 
things, there vas the game tree which described the pattern of 
decisions for the various playere. Assigned to the end points of the 
tree were certain outcomes, for the ei^ point of the tree describes a 
unique path of decisions through the tree. Sow, if it is asauaed 
that each of the players has a preference pattern among the possible 
outcomes and gaobles involving these outcomes which satisfy the seven 
axioms abcre, then we bsow that for each player ^eh outcose can be 
represented by a Txamrieal utility. Snzs, we can replace the assign- 
ment of outcoBies to the end points by the assigmaent of the correspond- 
ing utilities. This new structure, which is the same as the rules of 
the sBoaa except that there are numbers (utilities) instead of outcomes, 
is known as the extensive fona of a game. 

♦ Problems 

1- nsing some of the seven axioms, show aOb . b. 

2- Derive the property expressed in axiom 5 troa the assumption a 
linear utility faction exists. IHscuss its plaiisibility. 

3- Choose any a, b € G such that a > b. Define u(s) = 1 and 
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u('b) 0. For aoy other e e how would jsm use aadoa 2 to 
detexadne the value u(c)7 (in tbe exLatence proof, this Is 
hov a is actually constructed! the other axioos are then 
utilised to shov that it is both order preserving and linear. 
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